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1.0 


SUMMARY 


Difficulties  with  the  implementation  of  persistent  Wide  Area  Motion  Imagery  (WAMI)  sensors 
to  support  real-time  military  missions  have  risen  within  Intelligence,  Surveillance,  and 
Reconnaissance  organization.  In  this  study,  cognitive  models  were  developed  of  real-time 
missions  currently  supported  by  narrow  field  of  view  Full  Motion  Video  (FMV)  and  WAMI 
sensors.  These  models  were  used  in  conjunction  with  a  cognitive  task  analysis,  creating  an 
Augmented  Operator  Function  Model  (OFM-COG).  This  thesis  describes  the  OFM-COG  and 
demonstrates  how  this  model-based  analysis  technique  can  document  the  cognitive  implications 
of  persistent  surveillance  with  motion  imagery.  The  analytic  procedures  required  to  build  this 
model  result  in  a  methodology  for  the  definition  of  an  information  display  system  specific  for 
intelligence  analysis  tasks.  Specifically,  the  models  developed  examine  the  cognitive  demands 
of  an  Imagery  Analyst  (IA)  during  a  real-time  mission,  with  WAMI  and/or  FMV.  From  this,  a 
set  of  cognitive  metrics  for  analyst  perfonnance  were  identified  for  the  real-time  military 
missions  in  persistent  surveillance. 
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2.0  INTRODUCTION 

2.1  Background 

Real-time  and  forensic  military  missions  are  supported  by  narrow  field  of  view  Full  Motion 
Video  (FMV)  and  persistent  Wide  Area  Motion  Imagery  (WAMI)  sensors.  Cognitive  models  of 
real-time  missions  currently  supported  by  these  sensors  and  analysts  can  help  understand  the 
effects  of  using  imagery  in  Intelligence  Surveillance  and  Reconnaissance  (ISR)  missions.  These 
models  can  be  used  in  conjunction  with  human  computer  interaction  analysis  in  which  to  develop 
cognitive  metrics. 

2.2.1  Research  Objective 

There  are  three  main  objectives  to  this  research.  They  are: 

1)  Develop  a  working  cognitive  model  for  intelligence  analysis  using  FMV 

2)  Develop  a  working  cognitive  model  for  intelligence  analysis  using  WAMI 

3)  Develop  cognitive  metrics  for  imagery  analysis  based  on  developed  models 

2.3  Literature  Review 

In  order  to  understand  and  model  the  cognitive  demands  associated  with  the  analysts  tasks  using 
motion  imagery,  the  nature  of  the  medium,  the  tasks  involved,  and  a  background  understanding 
of  cognitive  modeling  is  needed.  The  following  sections  outline  the  topics  that  are  relevant  to 
understand  the  domain  and  methodology  for  this  research. 

2.3.1.  ISR 

The  goal  of  ISR  is  to  provide  actionable  intelligence  to  decision  makers.  The  mechanics  by 
which  intelligence  is  obtained  involves  a  complex  operation  of  systems  and  processes. 
Developing  metrics  for  cognition  and  performance  for  the  Imagery  Analyst  (IA)  in  this  system 
requires  an  understanding  of  the  current  structure. 

The  collection  management  processes  can  be  thought  of  as  the  main  entry  point  to  the  ISR 
process  (Gibbs,  Fendley,  Hoenle,  &  Paul,  2013).  Requests  for  Information  (RFI)  are  received 
from  all  theater  organizations.  These  requests  are  assessed  for  validity,  consolidated,  and 
analyzed  against  existing  intelligence  to  detennine  if  a  new  collection  is  required  or  if  the  request 
can  be  answered  with  existing  intelligence.  If  a  new  Collection  Requirement  is  necessary,  a 
collection  manager  will  integrate  the  requirement  into  the  collection  plan  for  a  specific  sensor. 
Customer  RFIs  are  not  passed  on  verbatim;  as  part  of  the  consolidation  process,  they  are  reduced 
to  common  Essential  Elements  of  Information  (EEIs).  These  EEIs  are  the  intelligence  questions 
that  mission  planners  attempt  to  collect  data  in  support  of,  and  analysts  ultimately  attempt  to 
answer. 

The  ISR  Team:  The  actual  execution  of  the  collection  plan  occurs  under  the  responsibility  of  an 
officer  within  the  Combat  Operations  Division.  The  officer  responsible  for  a  given  mission  is 
referred  to  as  the  Mission  Operations  Chief  (MOC)  (or  Commander).  The  MOC  coordinates 
execution  of  the  mission  and  remains  in  constant  communication  with  the  pilot,  sensor  operator, 
and  mission  supervisors,  such  as  the  Imagery  Mission  Supervisor  (IMS).  The  IMS  is  responsible 
for  exploitation  of  imagery  intelligence  and  coordinates  the  flow  of  information  between  analysts 
and  the  MOC.  The  work  described  here  focuses  on  the  viewpoint  and  tasks  of  the  analysts  after 
they  receive  information  from  the  IMS. 
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2.3.2.  Persistent  Surveillance 

ISR  challenges  are  many.  These  include  information  overload  coupled  with  new  persistent 
surveillance  processes,  one  of  those  being  WAMI.  There  are  also  the  issues  of  data  overload, 
information  gaps  and  the  need  for  a  clear  user-centered  interface  design  philosophy. 

Clarity  of  the  images  is  important,  as  well  as  the  geo-location  of  a  scene  and  all  the  elements  in 
it.  Future  needs  for  full  motion  video  includes  the  move  toward  higher  resolution  visible  video, 
trend  in  data  density  from  other  sources,  and  how  to  handle  the  data  load  given  bandwidth 
constraints  and  the  need  to  complete  tactical  analysis  in  near  real-time  (Hogan,  2012). 

Data  Overload:  Metadata  is  the  data  about  the  images,  such  as  details  of  objects,  input  from 
different  sensors,  or  other  infonnation  related  to  the  EEI  and  the  area  under  inspection.  Speed 
with  which  an  analyst  gets  imagery,  is  able  to  examine  it  and  then  disseminate  results  in  a 
suitable  format  is  critically  important.  A  problem  that  needs  to  be  overcome  is  handling  the 
large  volumes  of  data  produced. 

An  analyst  spends  80%  of  their  time  discovering  items  of  interest  in  imagery.  Pixel  level  search 
algorithms  can  find  and  track  items  of  a  particular  shape  and  color.  These  algorithms  can  help 
automate  the  process,  and  attempt  to  alleviate  analyst  workload. 

Compression  of  data  is  needed  and  this  can  happen  through  on  board  processing  that  can  be 
adjusted  to  accommodate  the  changing  bandwidth  conditions.  Software  has  been  developed  that 
stabilizes  and  geo-locates  video  as  it  comes  in;  ensuring  that  what  an  analyst  sees  is  not  distorted 
by  one  feed  being  particularly  clear  or  murky.  Analysts  can  also  set  up  ‘exclusion  zones’  in  the 
imagery,  so  that  background  movement  of  only  a  few  pixels  from  frame  to  frame  is  ignored  and 
only  greater  foreground  motion  is  highlighted.  Everything  is  pulled  into  a  central  view  and  the 
sensors  are  unified  into  one  system.  Because  of  this  condensation,  software  and  the  full  motion 
video  can  be  manipulated.  An  example  of  this  is  to  transmit  moving  objects  or  objects  with  an 
Infra-Red  (IR)  signature  at  a  higher  bit  rate  in  order  to  highlight  these  for  the  IA,  while 
transmitting  the  rest  of  the  area  at  a  much  lower  bit  rate. 

Information  Gap:  Integration  across  multiple  sources  creates  an  infonnation  gap  in  the  analysis 
and  there  is  a  need  to  design  the  technology  to  fit  the  capabilities  of  humans.  FMV  can  be 
overlaid  with  relevant  data,  such  as  events,  force  positions  and  intelligence  from  data  streams 
involving  radar,  maps,  persistent  surveillance  and  other  sensors.  The  goal  is  to  tie  all  the 
intelligence  assets  together,  which  would  increase  the  identification  of  a  potential  target.  The 
software  can  isolate  and  pull  out  an  image  or  recording  instantly.  There  is  a  semantic  gap  within 
persistent  surveillance  imagery.  The  imagery  presents  a  difference  in  representations  of  content 
of  interest  and  data.  The  content  of  interest  is  defined  in  very  abstract  terms  related  to  how 
humans  interpret  video  imagery  and  the  data  is  defined  in  very  physical  terms  related  to  the 
imaging  device. 

Automation:  Hogan  (2012)  states  that  the  480th  ISR  Wing’s  Hudson  wants  to  see  analysis  more 
automated.  He  compares  ISR  to  casinos  detecting  card  counters,  scam  artists  and  other  unknown 
troublemakers  in  a  crowd.  The  recognition  of  objects  using  current  software  creates  too  many 
false  positives  and  too  many  false  negatives.  Better  algorithms,  more  computing  power  and 
sharper  video  may  solve  this  problem.  Even  if  systems  that  are  being  developed  cannot  identity 
objects  with  a  high  degree  of  certainty  by  automation,  the  system  could  reduce  the  workload  by 
filtering  out  the  unimportant  aspects  from  the  large  amount  of  imagery.  This  will  help  to  solve 
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the  manpower  shortage  and  cognitive  workload  issues  because  analysts  could  then  concentrate 
on  a  smaller  amount  of  data. 

User-Centered  Design  Philosophy:  User  models  can  be  integrated  with  data-driven  models  in  a 
way  that  provides  scalable  and  dynamic  model  adaptation  and  refinement  for  particular  end  users 
and  specific  applications.  The  objective  is  to  help  increase  the  user’s  situation  awareness  and  the 
main  performance  criterion  is  user  productivity.  Research  can  show  how  much  data  the  user  can 
reliably  monitor.  Three  main  areas  of  research  address  this  issue;  search,  analysis  and  human 
computer  interaction. 

Search  Tools:  Tool  development  for  the  user  community  attempts  to  provide  users  with 
computational  tools  that  help  identify  components  of  scenarios  (e.g.,  activities).  This  includes 
automation  of  the  more  tedious  and  labor  intensive  parts  of  data  exploitation.  Four  broad 
categories  of  search  exist  within  the  IA  tasks;  database  queries,  meeting  queries,  track  queries, 
and  coordinated  track  queries.  An  intelligence  analyst  may  perform  a  database  query  to  obtain 
computational  information  from  a  known  database.  Relationships  between  multiple  track 
segments  are  meeting  queries,  and  these  have  a  high  number  of  false  alarms.  Combined  multiple 
track  segments  are  track  queries.  Coordinated  track  queries  focus  on  multiple  vehicles  driving 
similar  or  related  routes  (e.g.,  coordinated  driving),  driving  to  and  from  common  locations,  and 
also  particular  formations  such  as  convoys  or  pursuit. 

Analysis  Environment:  The  aim  is  to  provide  an  analysis  environment  where  tools  can  be 
applied,  data  visualized,  and  human  users  empowered  to  monitor  more  data  in  less  time.  This 
includes  data  aggregation  maps  used  to  focus  a  user’s  attention  to  a  target.  Visual  analytics  aims 
to  complement,  rather  than  replace  users  in  data  exploitation. 

Human  Computer  Interaction:  Human  computer  interaction  is  the  interaction  between  the  user, 
the  search  tools,  and  the  analysis  environment  in  the  ISR  system.  This  interaction  contains 
valuable  information  about  the  user’s  preferences  and  priorities.  It  contains  the  user’s  domain 
knowledge  of  the  data  set  and  collection  area.  As  progress  is  made  in  search  tools  and  the 
analysis  environment,  folding  the  domain  knowledge  back  into  the  data-driven  model  to 
maximize  the  joint  human-computer  productivity  will  become  increasingly  important  for  robust 
scenario  extraction. 

Feedback:  An  important  mechanism  to  mitigate  uncertainty  in  the  data-driven  model  is  to 
engage  users  to  visually  validate  and  correct  query  results  through  feedback.  By  accumulating 
user  feedback  over  a  given  geographic  area  and  over  long  periods  of  time,  each  new  user  does 
not  need  to  start  from  scratch.  This  can  be  accomplished  by  identifying  the  most  popular  queries 
and  push  these  back  into  the  data-driven  model.  The  two  main  advantages  are,  it  makes  the 
query  results  immediately  available  to  all  users,  and  the  query  can  be  used  to  improve 
performance.  This  is  known  as  accumulated  feedback.  The  system  records  relevant  feedback 
from  the  queries  and  the  sequence  of  interactions  between  the  user  and  the  WAMI  information 
system. 

Video  Imagery  in  ISR:  WAMI  is  a  rapidly  developing  sensing  modality  characterized  by  the 
collection  of  Electro-Optical  or  Infra-Red  (EO/IR)  images  with  very  large  spatial  extents.  Frame 
rates  are  typically  quite  low,  one  to  two  frames  per  second,  well  below  the  typical  criteria  of  24- 
30  frames  per  second  for  FMV  as  defined  by  the  National  Geospatial-Intelligence  Agency 
(United  States  Air  Force,  2012). 
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WAMI  is  used  in  ISR  to  image  small  city-sized  areas  at  approximately  0.5m/pixel.  This  allows 
for  the  observation  of  many  dynamic  phenomena  that  were  previously  inaccessible  in  street-level 
video  data.  Imagery  is  typically  acquired  by  multiple  independent  cameras,  physically  arranged 
to  have  overlapping  fields  of  view  and  co-mounted  on  an  airborne  platforms.  As  images  are 
collected,  they  are  passed  through  a  series  of  feed-forward  models  that  produce  a  higher-level 
compact  representation  that  quantifies  content  and  variation  of  interest.  A  feed-forward  model 
includes:  1)  geo-registration  and  stabilization;  2)  detection  of  vehicles  and  people;  and  3) 
tracking  of  vehicles  and  people.  The  first  step  in  developing  ISR  imagery  is  to  stitch  images 
from  the  multiple  cameras  into  a  single  frame. 

WAMI  brings  some  unique  characteristics  to  the  field  of  ISR.  It  uses  multiple,  fixed,  high 
frame-rate,  and  narrow  field  of  view  video  cameras.  It  has  a  persistent  data  collection  that  allows 
systems  to  build  and  exploit  statistical  models  of  normal  behavior  over  time.  It  has  a  fixed  frame 
of  reference  that  makes  it  easy  to  create  models  of  the  observable  area  that  can  be  used  to 
provide  contextual  infonnation  relevant  to  many  activities  of  interest. 

WAMI  exploitation  has  three  levels.  These  levels  are  based  on  exploitation  time. 

•  First  Level:  To  detect  immediate  events  using  sensor  data.  Geospatial  locations  of 
vehicles  and  people  at  each  point  in  time  contribute  to  assessing  identifiable  events. 

•  Second  Level:  To  detect  groups  or  patterns  of  events  that  correspond  to  activities 
of  interest  (e.g.,  vehicle  tracks).  These  can  include  multivehicle  activities  such  as 
meetings  and  coordinated  driving. 

•  Third  Level:  To  detect  groups  of  activities  or  scenarios  that  may  unfold  over  days 
or  weeks. 

There  are  challenges  to  WAMI  over  the  traditional  FMV  imagery  collection  method,  these 
include  geo-registration  and  stabilization.  Exploitation  of  this  motion  image  data  is  challenging 
due  to  the  size  of  the  geographic  area  covered  by  the  sensor  collection  and  the  complexity  of 
urban  environments.  Geo-registration  challenges  occur  due  to  collection  geometry  and  the 
significant  variation  in  ground  plane  elevation  due  to  the  wide  field  of  view.  One  way  to 
compensate  for  these  effects  is  to  use  elevation  maps,  but  they  are  rarely  up-to-date  or  at  the 
resolutions  required.  WAMI  also  only  offers  lower  levels  of  spatial  and  temporal  resolution 
which  can  be  troublesome. 

In  ISR  robust  object  detection  is  critical,  and  this  can  be  difficult  in  WAMI.  Low  spatial 
resolution  means  objects  of  interest,  such  as  vehicles  and  people,  cover  very  few  pixels.  Also, 
low  temporal  resolution  means  point-like  moving  objects  can  move  significant  distances  between 
frames.  Geo-registration  and  stabilization  errors  in  WAMI  can  introduce  a  large  amount  of 
motion  clutter.  Some  solutions  to  these  problems  have  been  introduced.  One  solution  method  is 
background  subtraction  from  video  analysis.  This  exploits  the  long-term  temporal  statistics  of 
each  pixel  and  can  suppress  specific  spatial  locations  such  as  trees  swaying  in  the  wind.  Change 
detection  is  another  possible  solution.  This  is  from  satellite  image  analysis  and  can  mitigate 
sudden  pervasive  differences  by  exploiting  the  fact  that  these  differences  affect  a  large  fraction 
of  the  image  such  as  illumination,  and  mis-registration.  Appearance  cues  can  be  used  by  the 
analyst  to  differentiate  or  classify  different  types  of  objects,  e.g.,  vehicles  versus  people. 

Software  algorithms  can  also  be  developed,  such  as  interest  point  detectors,  but  there  is  much 
work  that  still  needs  to  be  done.  Specificity  of  these  algorithms  is  low,  they  need  to  be  optimized 
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for  speed,  and  spatial  resolution  and  the  image  quality  need  to  improve  before  the  large  body  of 
appearance-based  object  detection  and  recognition  algorithms  will  become  more  relevant. 

In  a  typical  ISR  mission  tracking  is  a  necessity  and  while  WAMI  is  efficient  there  are  some 
challenges.  Tracking  is  defined  as  viewing  an  object  or  person  from  the  point  of  origin  to  their 
final  destination.  The  low-frame  rate  of  WAMI  means  vehicles  travel  several  vehicle-lengths 
between  frames.  The  low  specificity  of  object  detectors  in  WAMI  means  all  vehicle  detections 
are  treated  equally.  Motion  clutter  introduces  large  numbers  of  false  detections  when  tracking  in 
WAMI.  Some  solutions  include  tracking  systems  that  can  utilize  movement  and  appearance 
cues,  prior  information  related  to  the  geographic  location  such  as  road  maps,  and  normalcy 
models.  A  state-transition-model  specifically  for  WAMI  can  propagate  the  position,  velocity  and 
other  attributes  of  vehicles  through  time  to  aid  in  tracking. 

WAMI  has  the  capability  to  use  fused  imagery.  The  sensors  available  include  thermal,  infrared, 
synthetic  aperture  radar,  and  multi-  and  hyper-spectral  imagery.  Fused  imagery  provides  better 
fingerprints  for  specific  objects  of  interest,  extend  the  viable  operating  conditions  of  wide-area 
systems  beyond  daylight  hours,  and  helps  to  deal  with  non-ideal  weather  conditions  such  as 
clouds. 


2.3.3.  Human-System  Modeling 

In  a  Joint  Cognitive  System  (JCS),  the  human  operators  and  technology  are  viewed  as  symbiotic 
or  simply  a  single  entity.  Understanding  and  guiding  the  user’s  process  comes  only  with  the 
shift  to  a  joint  systems  view  that  emphasizes  the  interactions  between  people,  technology,  and 
work  (Hollnagel  &  Woods,  2005).  It  is  characterized  as  a  relationship  in  which  humans  and 
computers  work  together  to  solve  something  that  neither  can  solve  alone  (Brezillon  &  Pomerol, 
1997).  People  and  computers  are  not  separate  and  independent,  but  are  interwoven  into  a 
distributed  system  that  performs  work  in  context  (Hollnagel  &  Woods,  2005). 

The  concern  is  that  the  human  is  being  left  out  of  the  equation  in  a  task.  So  the  systems  are 
being  thought  of  as  stand-alone  systems  with  no  human  input.  For  example,  at  border  crossings 
the  machine  is  used  to  filter  out  difficult  cases  and  those  difficult  cases  where  the  machine  can’t 
decide  whether  or  not  this  is  the  person  who  they  claim  to  be,  will  be  handed  over  to  a  human 
operator,  without  any  consideration  of  how  well  the  human  will  do  this  task.  In  fact  we  know  the 
human  will  find  that  a  rather  difficult  task,  due  to  human-automation  interaction  issues  or  loss  of 
situation  awareness.  Little  consideration  is  given  to  what  happens  when  the  human  is  only  given 
the  difficult  tasks  to  deal  with.  As  a  result  it  is  apparent  that  the  machine  system  and  the  human 
need  to  be  considered  together  as  a  single  entity  (Hollnagel  &  Woods,  2005).  Using  model- 
based  design  can  help  achieve  this  goal. 

Modeling  human-system  interactions  aids  in  decision  making,  defining  metrics,  and  developing 
Decision  Support  Systems  (DSSs)  for  the  human-system.  Models  are  problem-driven  and 
narrowly  focused  on  joint  cognitive  systems.  For  example,  cognitive  models  have  proven  useful 
in  identifying  mode  transitions  in  jetliners  (Degani,  Mitchell  &  Chappell,  1995)  and  reducing 
cognitive  workload  during  ship  navigation  (Lee  &  Sanquist,  2000).  They  have  also  been  applied 
in  usability  assessments  of  complex  Graphical  User  Interfaces  (GUIs)  and  in  developing  training 
regimens  for  novices  in  experience-crucial  tasks.  Human  system  interaction  models  are  bound 
by  the  collective  limitations  of  the  humans  and  the  machines  in  the  joint  cognitive  systems  based 
on  the  unique  limitations  of  each.  The  following  five  sections  details  human  cognitive  modeling, 
metrics  from  these  models,  and  specific  models  used  in  this  thesis. 
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Cognitive  Modeling:  The  goal  of  cognitive  modeling  is  to  detail  the  relationship  between  a 
human  operator  and  his  environment  from  the  point  of  cognitive  processing.  The  human 
operator  must  be  studied  in  a  complex  and  dynamic  environment  to  accurately  diagram  relevant 
events  and  behavior.  Because  of  this,  the  operator  is  able  to  be  properly  modeled  within  his 
world.  These  observed  events  identify  specific  behaviors,  perfonnance  characteristics,  decisions, 
related  physical  actions,  and  their  relations  to  one  another  within  the  system. 

There  are  many  widely-used  cognitive  models  developed  from  research,  in  both  Engineering  and 
Psychology  disciplines.  Because  of  the  abundance  of  models,  it  has  been  found  that  specific 
models  are  best  suited  for  particular  types  of  systems,  applications,  and  analyses  (Stanton, 
Salmon,  Walker,  Baber,  &  Jenkins,  2012).  Some  models  focus  on  attention,  working  memory, 
perception,  or  decision  making  at  different  degrees  (Leiden  K.  ,  Laughery,  Keller,  French, 
Warwick,  &  Wood,  2001).  An  example  of  an  attention-based  model  is  Situation  Awareness 
Global  Assessment  Technique  (SAGAT).  The  Goals,  Operator,  Methods,  and  Selection 
(GOMS)  rule  is  a  specialized  human  information  processor  model.  And  the  Recognition-Primed 
Decision  (RPD)  model  is  focused  on  human  decision  making  processes  and  speed. 

Cognitive  modeling  of  human-system  interactions  entails  identifying  the  salient  infonnation  that 
is  critical  to  the  operator.  This  requires  overcoming  two  key  cognitive  engineering  challenges 
typically  faced  in  complex,  dynamic  environments,  such  as  the  IA  in  the  ISR  system.  These 
challenges  are  how  to  avoid  brittleness  and  how  to  address  semantic  issues.  Brittleness  or  a  lack 
of  robustness  is  due  to  the  variability  of  the  dynamic  environment  in  which  the  operator  is 
functioning  (Fendley,  2009).  Improvements  can  be  made  by  implementing  DSSs  that  provide 
strategies  to  the  operator  and  giving  feedback  about  the  results  or  increasing  visualization  in 
order  to  make  the  abstract  information  more  concrete  in  better  understanding  the  changes  that 
occur  within  the  environment.  In  order  to  make  use  of  this  requires  careful  understanding  and 
representation  of  the  system,  which  can  be  conceptualized  as  a  cognitive  model.  The  impact  of  a 
DSS  on  analyst  biases  while  looking  at  the  time  taken  to  identify  the  targets  in  the  images,  the 
accuracy  of  the  target  designations,  and  the  participants’  confidence  level  in  those  designations  is 
previous  work  by  Fendley  (2009).  The  second  challenge  is  due  to  semantic  issues.  With  a 
properly  designed  display  the  amount  of  semantic  errors  should  be  low  and  the  operator  must  be 
able  to  properly  internalize  how  the  system  works  as  it  functions. 

There  are  both  subjective  and  objective  measurements  associated  with  cognitive  modeling.  In 
some  instances,  objective  measurements  are  hard  to  obtain  and  in  these  situations  subjective 
measurements  (i.e.  confidence)  are  used  and  accepted.  Subjective  measurements  can  be  used  in 
order  to  accurately  develop  objective  measures  later  on. 

Operator  Function  Model  (OFM):  Mitchell  (1987)  introduced  the  OFM  as  a  method  for  model- 
based  design.  The  OFM  consists  of  a  network  of  nodes  and  arcs  that  represent  how  an  operator 
manages  multiple  concurrent  activities  within  a  complex,  dynamic  event-driven  system  (Jones, 
Chu,  &  Mitchell,  1995).  The  OFM  is  a  structure  of  finite-state  systems  describing  operator 
functions.  In  an  OFM,  network  nodes  represent  the  activities  of  the  operator  at  multiple  levels 
and  arcs  connect  conditions  that  can  start,  end,  or  sequence  the  activities.  The  OFM  represents 
the  relationships  between  dynamic  system  states  and  operator  activities. 

There  are  different  components  of  the  OFM.  Nodes,  functions,  sub-functions,  actions,  and  arcs 
are  identified  and  defined  within  the  model.  Discrete  nodes  (finite  states)  are  organized  within  a 
network  of  arcs  (state  transition  functions)  to  fonn  a  finite  automaton.  Arcs  introduce  the 
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dynamic,  event-driven  dimensions  to  the  model.  Arcs  can  represent  system  events  that  interrupt, 
start-up,  or  complete  an  activity  (Thordsen,  Hutton,  &  Anastasi,  1998).  Simultaneous  activities 
are  displayed  as  a  collection  of  nodes  without  connecting  arcs.  The  model  is  organized 
heterarchically  and  hierarchically,  detailing  discrete,  alternative  functions  in  parallel  with  their 
associated  downstream  sub-functions.  Operator  goals,  functions,  sub-functions,  and  physical 
actions  are  organized  from  top  to  bottom  in  a  recognizable  manner  within  the  OFM.  The  OFM  is 
a  normative  model,  meaning  given  specific  system  states  it  predicts  operator  actions. 

According  to  Muller  and  Narayanan  (2009),  “The  goals  of  the  modeling  process  are  to  detennine 
the  type  and  style  of  information  to  be  presented  to  the  human  user,  and  to  establish  the  technical 
demands  of  the  system  in  the  context  of  the  user’s  needs.”  The  OFM  is  a  useful  model  due  to  its 
inherent  flexibility,  and  through  it  we  can  study  both  the  cognitive  actions  of  the  human  and  the 
transitions  that  occurred  from  one  action  to  the  next. 

The  OFM  has  some  advantages  as  a  cognitive  model.  The  first  is  reduction  of  complexity:  It 
consolidates  a  real-word  system  on  paper  and  provides  an  understanding  of  manifold  system 
states.  It  identifies  mismatched  system  configurations  (conditions  under  which  the  joint- 
cognitive  nature  fails).  Finally,  it  offers  a  representation  of  system  constraints  and  dynamics  - 
the  possible  and  impossible  pathways  are  represented,  providing  a  bounded  system  graphic.  The 
second  advantage  is  internal  validation.  The  model  showcases  a  high  degree  of  validity  in 
predicting  outputs  as  a  function  of  inputs.  And  the  model  is  non-simulative  and  relatively  easy  to 
construct  and  iterate  at  almost  no  expense. 

The  OFM  showed  the  greatest  advantages  and  relevance  in  modeling  IA  tasks.  The  OFM  has 
been  proven  effective  in  supporting  real-world  applications;  including  the  types  of  actions  an  IA 
performs  (Lee  &  Sanquist,  2000;  Dave  R.  ,  Ganapathy,  Fendley,  &  Narayanan,  2004;  Jones  & 
Jacobs,  2000;  McNeese,  Bautsch,  &  Narayanan,  1999).  OFMs  are  well-established  in 
supervisory  controller  and  system  monitoring  tasks.  The  OFM  captures  the  routine 
sensory/display  tasks  in  a  dynamic  environment  and  the  higher  level  cognitive  tasks  of  the 
operator.  Most  importantly  though,  the  OFM  will  be  useful  in  answering  critical  performance¬ 
determining  questions:  What  are  the  operator’s  needs?  What  cognitive  challenges  are 
experienced  by  the  operator?  Is  there  an  aid  that  can  address  these  needs  and  challenges?  The 
OFM  will  offer  solutions  to  these  questions  among  others  that  have  yet  to  be  asked. 

Cognitive  Task  Analysis  (CTA):  CTA  is  a  method  for  describing  and  representing  a  human 
operator’s  cognitive  processes  during  a  complex  task  or  scenario.  The  CTA  provides  us  with  a 
set  of  methodologies  for  eliciting  both  general  domain  knowledge  and  specific  knowledge 
pertaining  to  the  decision  requirements  for  the  critical  decisions  made  in  the  operational 
environment  (Thordsen,  Hutton,  &  Anastasi,  1998).  CTA  is  a  unique  and  diverse  tool  in  which  it 
provides  information  about  how  operators  conceptualize  tasks,  recognize  critical  information  and 
patterns  of  cues,  and  the  strategies  that  they  use  to  assess  situations,  solve  problems,  and  make 
judgments  and  decisions  (Cooke,  1999;  Gordon,  Schmierer,  &  Gill,  1993;  Hall,  Gott,  &  Pokorny, 
1995).  CTAs  are  frequently  applied  to  usability  analyses  of  software  systems,  graphic  user 
interfaces,  and  physical  control  schemes.  Any  type  of  user  interface  can  be  evaluated  using  the 
CTA.  CTAs  are  particularly  useful,  according  to  Davison  (2002),  because  modern  advances  in 
technology  trend  toward  increasing  cognitive  demands  on  operators  instead  of  decreasing  them  - 
pa  modern  system  is  not  necessarily  a  more  usable  system.  This  type  of  analysis  is  typically 
used  to  test  teams  of  individuals  with  varying  domains  and  degrees  of  expertise  to  evaluate 
system  prototypes  and  even  completed  systems.  The  test  subjects  complete  individual  tasks  from 
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different  stages  of  use,  in  which  these  tasks  are  designed  to  expose  flaws  in  system  usability. 

The  participants  are  observed,  recorded  (audio/video/paper),  and  probed  while  completing  the 
tasks.  The  final  model  of  this  analysis  represents  a  progression  of  cognitive  processes.  Main 
goals  are  broken  down  into  sub-goals,  which  are  further  analyzed  to  functions  and  actions  to 
improve  system  performance,  identity  human-system  mismatches,  decision  making  pathways, 
and  operator  judgment.  The  goal  of  a  CTA  is  to  identify  the  cognitive  skills,  or  mental  demands, 
that  are  needed  to  perfonn  a  task.  These  include:  critical  cues  and  patterns  of  cues;  assessment, 
problem-solving  and  decision-making  strategies;  difficulties  associated  with  the  system  for 
novices;  and  common  novice  errors  (Thordsen,  Hutton,  &  Anastasi,  1998). 

A  technique  used  to  conduct  a  CTA  is  the  method  of  Cognitive  Walkthrough  (CW).  This 
technique  strives  to  address  the  operator’s  usability  of  the  system,  specifically  the  display 
interface.  CWs  provide  insight  as  to  how  easily  an  operator  can  perform  a  complex  problem¬ 
solving  scenario  during  a  dynamic  task  or  scenario.  CW  assumes  operators  employ  problem¬ 
solving  facilities  during  acquisition  of  new  skills  (Sears  &  Hess,  1999).  A  CW  is  not  a  lab-based 
method  and  is  administered  on-  or  off-site  during  regular  activities.  Because  CW  is  more  an 
applied  “in  process”  assessment  and  less  a  “post-design”  assessment,  it  does  not  require  a  full 
system  description  prior  to  use.  This  renders  the  method  easier  to  administer  and  more  intuitive 
to  the  engineer  without  requiring  intimate  knowledge  of  the  software  or  hardware.  This  method 
is  iterative  and  may  be  applied  continually  throughout  the  design-period  of  a  developing  system, 
leading  to  unexpected  and  highly  informative  discoveries  with  direct  benefit  toward  the  usability 
of  the  system.  CW  maximizes  usability  in  a  Human-Computer  Interface  (HCI)  and  positions  the 
operator  for  superior  decision-making  in  the  majority  of  scenarios.  The  knowledge  gained  by 
these  methods  increase  HCI  robustness  and  mitigates  operator  errors. 

OFM-COG:  The  OFM  itself  does  not  capture  the  cognitive  demands  imposed  on  the  operator, 
but  these  are  the  elements  needed  in  developing  cognitive  metrics  in  analyst  perfonnance.  Lee 
and  Sanquist  (2000)  proposed  an  augmentation  to  the  OFM  using  a  table  of  cognitive  functions. 
Using  taxonomy  of  cognitive  agent  tasks  derived  from  Miller  (1974),  they  showed  how  a 
detailed  model  can  be  developed  of  the  cognitive  resources  associated  with  an  activity,  and  how 
those  resources  are  utilized. 

Lee  and  Sanquist  (2000)  tabulate  cognitive  operations  in  uniform  system  engineering  terms.  For 
each  function  and  sub-function  of  an  OFM,  five  characteristics  are  identified: 

•  cognitive  agent  tasks  using  Miller’s  taxonomy  (1974); 

•  inputs  to  the  activity; 

•  human  information  processing  resources  -  such  as  perceptual  sensitivity,  attention, 
memory,  etc.; 

•  outputs  from  the  activity; 

•  task  and  environmental  demands  specific  to  the  domain 

Cognitive  Function  Modeling  provides  a  decision-centered  view  of  the  complex  system. 
Cognitive  Function  Modeling  combines  function-  and  task-level  descriptions  from  an  operator’s 
perspective  with  description  of  the  level  of  “cognitive  complexity”  involved  with  each  function 
and  task.  The  Cognitive  Function  Modeling  highlights  tasks  and  functions  that  must  be 
understood  of  the  complexity  of  the  task  before  allocating  the  function  to  the  physical  system  or 
the  human  operator.  These  are  the  tasks  or  functions  which  require  complex  decision  making  or 
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judgments.  These  tasks  and  functions  are  flagged  by  a  measure  of  cognitive  complexity.  The 
issues  and  possible  design  implications  to  deal  with  these  issues  are  emphasized,  and  supported 
by  data  from  a  CTA  which  puts  the  task  into  the  context  of  cognitive  demands,  decision,  and 
judgments  required  of  an  operator  trying  to  accomplish  that  task  (Thordsen,  Hutton,  &  Anastasi, 
1998). 

2.3.4.  Cognitive  Agent  Tasks 

Miller  (1974)  explores  the  importance  of  the  interaction  between  human  behavior  and  work 
situations  in  task  analysis,  through  behavior  and  task  strategies.  Behavior  strategies  are 
techniques  intended  to  maximize  the  operator  as  a  processing  resource.  The  operator  learns 
strategies  which  specifically  offset  certain  types  of  error,  or  which  increase  the  amount  of  task 
information  they  can  process  in  a  given  amount  of  time,  or  increase  reliability  in  performance. 
Learned  behaviors  help  the  operator  perform  the  task  better,  but  at  some  risk  to  the  task  being 
properly  accomplished.  Task  strategies  are  techniques  for  coping  more  effectively  and 
efficiently  with  the  uncertainties  of  a  work  environment.  This  distinction  in  work  strategies 
helps  generate  a  procedure  for  analysis  of  work  situations  that  is  comprehensive  (Miller,  1974). 
Miller’s  (1974)  taxonomy  of  information  processing  tasks  adapted  to  the  tasks  conducted  by  an 
IA  is  shown  in  Appendix  A. 

2.3.5.  Summary 

The  previous  sections  outlined  the  relevant  information  needed  for  this  thesis  on  the  ISR  system 
and  Human  System  Modeling.  With  this  were  the  types  of  models  used  and  their  purposes 
within  the  study  of  Joint  Cognitive  Systems.  The  next  section  of  this  thesis  presents  the  research 
methodology.  This  includes  the  knowledge  acquisition  technique(s),  data  reduction  process, 
selection  of  a  cognitive  model,  and  development  of  that  model. 
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3.0 


RESEARCH  COMPONENTS 


The  research  questions  and  methodology  taken  composed  the  backbone  of  this  report.  These 
components  are  described  in  the  following  two  sections. 

3.1  Research  Questions 

In  this  research,  there  were  three  main  research  questions  established  based  on  the  previously 
stated  research  objectives: 

•  What  are  the  cognitive  challenges  associated  with  imagery  analysis? 

•  How  do  we  measure  the  challenges  of  the  tasks  associated  with  imagery  analysis? 

•  Can  we  develop  a  model  that  addresses  these  challenges  and  identifies  potential 
aids  in  the  process? 

The  research  approach  taken  was  aligned  with  answering  these  three  questions.  The  next  section 
will  outline  and  explain  the  research  methodology  utilized. 

3.2  Research  Framework 


Figure  1:  Research  Framework 
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The  first  step  in  any  research  effort  is  to  define  the  research  objectives  to  be  studied.  These  goals 
were  stated  in  Section  2.0  as  defining  and  understanding  the  cognitive  challenges  of  an  IA. 
Identifying  the  research  objectives  made  it  easier  to  narrow  the  domain  that  was  to  be  examined. 

A  literature  review  and  collection  of  background  infonnation  was  prepared  in  alignment  with  the 
research  objectives.  Based  on  the  collected  background  infonnation,  interview  questions  and 
topics  were  produced  for  Subject  Matter  Expert  (SME)  dialogues.  The  best  elicitation  methods 
for  this  research  were  chosen  as  interviews  and  simulated  interviews,  due  to  the  classified  nature 
of  the  real  world  ISR  system  and  availability  of  SMEs.  These  interviews  and  simulated 
interviews  were  used  as  data  collection  techniques,  and  cognitive  walkthroughs  were  used  in 
conjunction  in  order  to  complete  a  CTA.  During  this  phase,  all  the  information  needed  to  create 
a  cognitive  model  was  gathered.  The  next  step  taken  in  this  process  was  data  reduction,  in  which 
irrelevant  information  was  identified  and  filtered  out.  The  reduction  stage  revealed  four  distinct 
missions  that  commonly  occur  within  imagery  analysis.  Then  the  cognitive  models  for  these 
missions  were  constructed. 

Once  all  the  data  was  collected  and  reduced,  the  cognitive  model  that  best  aligned  with  the 
research  objectives  was  chosen  as  the  representation  method  for  identifying  challenges  and 
potential  aids  for  imagery  analysis.  The  OFM-COG  was  chosen  for  this  effort.  First,  the  OFMs 
for  each  of  four  missions  were  developed  (see  Section  4.4. 1  for  detailed  explanation  of  creation) 
from  the  data  collected,  then  the  cognitive  tables  for  those  four  missions  were  created  (see 
Section  4.4.2  for  detailed  explanation  of  creation)  in  order  to  best  complete  the  human  system 
model  based  on  the  previous  stated  research  objectives. 

After  the  OFM-COG  was  developed,  the  technique  chosen  to  validate  the  model  was  a  review  by 
a  panel  of  SMEs.  The  SMEs  used  in  this  stage  were  different  than  the  experts  used  in  the  data 
collection  phase  in  order  to  give  more  accuracy  to  the  models.  The  models  were  revised  (see 
Section  5.2  for  detailed  revisions)  based  on  the  experts’  inputs  obtained  in  the  validation  process. 
The  final  models  were  then  analyzed  to  attain  the  answers  for  the  research  questions  stated  in  the 
previous  section.  The  cognitive  challenges,  metrics,  and  potential  aids  for  imagery  analysis 
acquired  from  the  final  OFM-COG  are  described  in  the  discussion  section  of  this  report. 

3.3  Methodology/Assumptions/Procedures 

Figure  2  provides  an  outline  of  the  detailed  research  methodology  and  is  explained  in  the 
following  sections. 
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Methodology  Outline 


Information 

Representation 


Figure  2:  Outline  for  Data  Collection  and  Model  Development 
3.3.1.  Subjects 

All  subjects  used  in  this  study  were  former  or  current  Intelligence  Analysts.  Both  FMV  and 
WAMI  analysts  were  used  in  this  study.  Due  to  scarce  availability  of  IAs,  three  FMV  analysts 
and  four  WAMI  analysts  were  able  to  be  studied. 

The  first  FMV  analyst  had  been  in  the  intelligence  community  for  six  years,  started  work  in  the 
Army  and  mainly  works  with  FMV  but  has  some  training  in  Wide-Area  Persistent  Surveillance 
(WAPS).  The  second  subject  had  ten  years  special  operations  experience,  five  years  in  Joint 
Special  Operations  Command  as  an  operator,  three  years  working  with  Unmanned  Aerial 
Vehicle  (UAV)  platforms,  and  an  additional  year  working  with  UAV  platforms  as  a  contractor. 
The  third  subject  had  12  years  of  intelligence  experience  as  an  Army  IA,  working  with  national 
imagery,  and  now  works  with  UAV  platforms  and  ISR  management. 
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Four  subjects  currently  using  WAMI  were  observed  in  simulated  interviews.  The  first  subject 
had  four  years  of  intelligence  experience  with  the  past  year  being  WAMI.  The  second  subject 
has  worked  with  intelligence  imagery  for  five  years  and  WAMI  for  two  years.  The  third  subject 
had  13  years  of  intelligence  experience  with  the  past  two  being  with  WAMI.  The  fourth  subject 
had  eight  years  intelligence  experience  with  the  Army  and  two  years  working  specifically  with 
WAMI. 


3.3.2.  Interview  Data  Collection 

As  part  of  this  research,  SMEs  in  FMV  analysis  at  varying  skill  levels  were  interviewed, 
primarily  FMV  analysts  providing  real-time  support  to  Army  customers.  In  Human  Factors 
Engineering,  the  three  most  common  data  collection  techniques  are;  interviews,  questionnaires 
and  observations  (Stanton,  Salmon,  Walker,  Baber,  &  Jenkins,  2012;  McNeese,  Bautsch,  & 
Narayanan,  1999).  Interviews  were  chosen  as  the  form  of  knowledge  elicitation  on  IA  task 
procedures  for  data  collection.  This  approach  delivered  a  balanced  tradeoff  between  information 
quality  and  convenience  to  the  Image  Analysts  -many  were  out  of  town  and  had  limited  time  for 
interviews.  In  the  course  of  these  interviews,  the  typical  missions  and  mission  tasks  they 
performed  were  discussed.  All  dialogues  were  held  at  an  unclassified  level. 

The  questions  developed  for  the  interview  were  structured  to  touch  on  four  main  areas  based  on 
the  research  objectives.  The  first  area  was  identifying  the  salient  information  necessary  for  the 
analysts  to  successfully  address  and  complete  a  given  mission.  Secondly,  to  address  the  physical 
and  cognitive  tasks  performed  by  the  IA  during  a  mission.  These  tasks  encompassed  interactions 
with  the  software  system  and  viewing  the  FMV  sensor  infonnation.  The  next  area  was  those 
cues  that  the  IAs  use  when  completing  a  given  EEI.  And  lastly  to  identify  the  goals,  functions, 
sub-functions,  and  actions  essential  to  a  successful  mission.  Basing  interview  questions  on  these 
areas  of  interest  the  challenges  of  FMV  sensor  analysis  can  be  addressed  in  a  cognitive  model, 
which  can  be  analyzed  to  detennine  cognitive  metrics. 

In  order  to  conduct  a  CTA  for  development  of  cognitive  models,  CWs  were  employed  during  the 
analyst  interviews.  These  were  utilized  for  accurate  development  of  the  OFM-COG  model  for 
Image  Analysts  performing  fielded  operations.  This  was  appropriate  because  the  OFM-COG  is 
used  to  support  conditions  for  constraints  on  the  execution  of  activities.  These  include  Inputs 
(conditions  for  initiation  of  activities),  Terminators  (conditions  for  cessation  of  activities),  Steps 
in  Execution  (logical  requisites  for  execution  of  activities),  and  Outputs  (logical  requisites  for 
completion  of  activities).  A  panel  of  investigators  conducted  the  interviews  to  obtain  accurate 
and  quality  information. 

3.3.3.  Interview  Data  Reduction 

The  combined  interview/CW  method  elicited  generous  knowledge  to  the  IA  process.  Topics 
discussed  were  pre-mission  research,  common  mission  types,  tools  utilized  during  missions,  and 
communication. 

Pre-Mission  Research:  The  amount  of  pre -mission  research  analysts  performed  differed.  One 
analyst  reported  performing  little  research,  while  a  more  experienced  analyst  uses  connections 
within  the  intelligence  community  to  acquire  information.  The  type  of  historical  information 
used  focused  on  records  of  enemy  activity.  Records  of  Improvised  Explosive  Device  (IED) 
incidents  with  geospatial  location  data  in  Keyhole  Markup  Language  (KML)  format  is  available 
for  use  by  the  IA.  This  gives  the  IA  a  quick  overview  of  past  activity  in  the  area.  There  are  also 
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image  databases  of  typical  threat  objects  in  use  within  the  area.  Analysts  reported  that  these  are 
less  frequently  referred  to.  Less  than  one  hour  is  available  for  pre -mission  research,  however 
under  dynamic  tasking  there  is  no  time  available  for  preparation  outside  the  transit  time  of  the 
aircraft. 

Mission  Types:  The  analysts  reported  perfonning  a  common  set  of  mission  tasks  including 
counter-IED  sweeps,  monitoring  of  convoy  routes,  and  battlefield  surveillance  for  troops  in 
contact  with  enemy  fire.  Based  on  this  information,  EEIs  were  developed  for  the  next  round  of 
interviews  with  WAMI  analysts. 

Tools:  Minimal  reliance  on  tools  was  reported  by  the  analysts.  A  common  general  purpose 
media  viewer  is  used  to  view  FMV.  No  geospatial  metadata  is  available  with  this  software.  And 
change  detection  is  performed  by  the  analyst  by  mentally  comparing  images.  An  image  analysis 
tool  is  not  generally  used. 

Communication:  The  analysts  remained  in  constant  contact  with  the  sensor  operator  and  the 
customer  during  real-time  missions.  Texting  within  a  chat  room  was  the  most  common  means  of 
communication.  Reporting  was  conducted  immediately  because  before  the  mission  the  customer 
would  state  their  desire  to  be  informed  of  all  indicators  as  soon  as  the  analyst  viewed  the  cue 
with  no  intermediate  filtering.  Analysts  reported  they  would  send  texts  of  cues  for  possible 
significant  activity  as  soon  as  they  were  viewed,  followed  by  explanations  to  the  significance. 
Then  the  customer  would  confirm  or  reject  that  cue  later. 

The  analysts  could  request  the  sensor  to  focus  on  specific  areas  if  needed.  These  requests  were 
made  from  the  analyst  to  the  sensor  operator  directly  through  the  chat  room.  No  machine 
interface  or  monitor  is  used.  Analysts  reported  these  sensor  moving  requests  in  terms  of  specific 
patterns  of  motion  resembling  visual  search  patterns,  as  a  way  of  using  a  common  language  for 
guiding  the  sensor. 

3.3.4.  WAMI  Data  Collection 

The  WAMI  interviews  were  structured  as  a  CW  with  simulations  using  a  similar  software 
program  as  in  a  real  world  environment.  EEIs  that  would  be  reportable  for  a  given  mission  were 
presented  to  the  SMEs.  These  high-level  tasks  were  broken  down  into  specific  physical  and 
cognitive  tasks  such  as  communications,  mapping  and  tracking.  The  analysts  identified  cues  to 
perform  the  specific  EEI  tasks.  The  tools  and  techniques  used  to  answer  those  EEIs  were 
observed.  This  made  it  possible  to  produce  a  set  of  goals,  functions,  sub-functions,  and  actions 
for  each  EEI.  All  tasks  were  given  in  a  random  order  for  each  individual  to  obtain  all  details  of 
missions. 

3.3.5.  WAMI  Data  Reduction 

These  simulated  interviews  with  WAMI  analysts  showed  differences  among  FMV  and  WAMI 
analysis  procedures.  The  FMV  interviews  concluded  that  few  tools  were  in  use  with  exploiting 
FMV  data  for  real-time  support.  In  fact,  FMV  analysts  reported  they  did  not  multitask  at  all, 
while  WAMI  analysts  reported  monitoring  and  exploitation  of  multiple  fields  of  view  and 
multiple  concurrent  events  within  the  sensor’s  area  of  interest. 

Due  to  the  vast  amount  of  data  collected  from  the  SMEs,  a  method  to  reduce  and  organize  was 
necessary  to  build  the  models.  Four  main  mission  types  conducted  by  the  IA  were  identified  and 
used  to  form  the  basis  of  the  models.  The  four  types  of  missions  an  Image  Analyst  could 
perform  are:  Counter  Improvised  Explosive  Device  (CIED)  for  a  Route  Scan,  Counter 
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Improvised  Explosive  Device  for  a  Rural  Scan,  Threat  to  Convoy,  and  Patterns  of  Life  (POL). 
The  cognitive  processes  and  associated  physical  tasks  for  these  four  missions  are  described  in  the 
following  sections. 

CIED  -  Route  Scan :  Two  counter-IED  searches  were  identified  by  the  analysts;  route  scan  and 
area  scan.  Lor  the  CIED  route  scan  mission,  the  analysts  described  their  initial  search  behavior 
as  a  “slow  scan”  along  the  whole  route  from  beginning  to  end  in  a  left  to  right  fashion.  More 
experienced  analysts  stated  they  would  begin  the  route  scan  by  spiraling  out  from  the  beginning 
of  the  route  to  better  understand  the  activity  and  terrain  in  the  area  of  interest.  After  this  they 
would  be  more  focused  on  the  details  of  the  route  being  scanned. 

Physical  and  activity-based  phenomena  were  reported  by  analysts  as  threat  cues  for  route  scan 
missions.  Physical  cues  would  include  disadvantaged  terrain,  for  example,  an  analyst  would 
increase  their  attentiveness  in  areas  that  had  limited  lines  of  view  or  movement  for  convoys. 
Other  cues  that  would  need  detailed  attention  would  be  areas  that  could  potentially  be  used  for 
IED  placement  and  ambush,  such  as  ditches,  buildings  and  drainage  culverts.  Some  of  these 
areas  could  have  previous  IED  or  threat  activity,  so  analysts  would  use  historical  information  to 
acquire  this  knowledge.  Analysts  reported  the  reasoning  behind  using  these  previous  reports  was 
because  if  an  attack  occurred  in  that  area  before  then  the  terrain  or  advantageous  point  may  be  of 
interest  to  another  potential  attacker.  Activities  that  would  be  deemed  cues  include  digging  in 
areas  that  are  not  agricultural,  uncharacteristic  traffic  patterns,  and  people  avoiding  the  route 
while  walking. 

During  a  route  scan,  disturbed  earth  of  thermal  anomalies  are  signs  of  potential  threats.  These 
would  be  investigated  by  the  analyst  using  a  local  image  archive  to  compare  images  and 
determine  timing  of  the  anomaly.  If  an  anomaly  was  detected,  recent  activity  would  have  a 
priority  over  older  activity.  This  is  due  to  the  reasoning  that  if  the  older  activity  was  in 
preparation  of  an  attack,  that  attack  would  have  already  occurred  against  past  travelers  down  the 
route. 

CIED:  Rural  Scan:  Customer  tips  or  “hits”  would  be  given  to  analysts  to  follow  up  on  potential 
hannful  activity.  This  location  would  be  within  an  area  of  interest  (AOI)  and  the  tip  would  be 
vague  in  detail.  Analysts  reported  that  this  would  require  a  tedious  search  for  general  suspicious 
activity  within  the  AOI.  The  analyst  stated  that  if  they  did  not  identify  any  potential  threat  after  a 
length  of  time  a  call  out  to  the  customer  would  be  made  for  additional  information. 

Threat  to  Convoy:  During  dynamic  convoy  monitoring  missions,  analysts  reported  search 
methods  similar  to  CIED  route  scans.  More  importance  would  be  put  on  behavior-based  activity 
of  pedestrians  in  the  AOI.  People’s  actions  near  the  convoy  would  be  reported  more  frequently 
and  provided  cues  as  to  significant  potential  threats.  In  a  convoy  monitoring  mission,  the  sensor 
would  be  constrained  to  only  an  “eyes-on”  the  lead  vehicle  in  the  convoy  though,  so  sensor 
maneuverability  would  be  limited. 

POL:  POL  missions  are  considered  behavioral  intelligence  missions  that  emphasize  the 
observed  human  activity  information  as  compared  to  a  baseline  of  normal  behavior.  Extended 
collection  periods  of  persistent  surveillance  can  create  this  type  of  intelligence.  The  same  sensor 
records  the  anomalous  and  baseline  activity  for  a  POL-type  mission. 

Analysts  emphasized  the  need  for  cultural  and  local  awareness  in  understanding  the  baseline  for 
these  missions.  For  example,  if  the  market  is  open  during  the  morning,  it  is  expected  that  more 
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people  will  be  active,  while  later  in  the  day  the  amount  of  people  will  decrease  dramatically.  If 
the  analyst  does  not  see  this  pattern  of  activity,  then  this  could  be  a  potential  anomaly  detected. 
Other  baseline  activities  include  normal  work  hours,  religious  observance  times  and  interactions 
between  people.  Analysts  confirmed  the  EEIs  that  were  given  as  cues  for  significant  activity 
within  a  mission,  but  they  were  not  able  to  articulate  a  list  of  behavioral  cues.  Instead,  analysts 
gave  vague  and  general  statements  such  as,  “normal  within  the  AOI  was  key.” 

3.3.6.  Model  Development 

By  structuring  the  simulated  interviews  to  address  specific  EEIs,  the  knowledge  elicited  was 
used  to  generate  a  working  cognitive  model.  The  model  developed  was  the  OFM,  which  applied 
the  goals,  functions,  sub-functions,  and  actions  of  the  analyst  during  one  of  four  missions.  This 
model  was  then  used  to  create  the  OFM-COG,  which  examined  the  cognitive  demands  of  these 
activities.  The  OFM-COG  was  generated  to  compare  cognitive  demands  across  tasks  by 
outlining  the  mental  flow  using  cognitive  agent  tasks.  This  led  to  the  opportunity  to  find  areas 
of  high  cognitive  load  with  potential  for  reduction  and  significant  challenges  for  the  IA  within 
the  task. 

OFM:  The  procedure  taken  to  construct  the  OFMs  in  this  research  was  based  on  the  approach 
taken  by  Mitchell  and  Miller  (1986).  During  the  simulation  interview,  the  goals,  functions,  sub¬ 
functions  and  actions  were  identified  for  each  task  to  better  create,  develop,  and  understand  the 
OFM.  Four  different  EEIs  were  able  to  be  modeled.  The  table  below  shows  the  steps  in  the 
OFM  construction. 


Table  1:  Steps  in  OFM  Construction 


Step 

Description 

1 

Identify  inputs 

2 

Identify  outputs 

3 

Identify  system  components  controlled  by  inputs  or  operator  action 

4 

Identify  operator  functions  and  sub-functions  as  groups  of  operator  actions 

5 

Identify  groupings  of  components  based  on  the  operator  actions  and  functions. 

6 

Define  a  next  state  transition  function  for  each  node  in  the  network. 

7 

Create  the  model  based 

The  model  construction  started  with  identification  of  exogenous  inputs  and  system  outputs.  The 
inputs  were  any  external  or  deterministic  events  that  seem  to  drive  the  system.  The  outputs  were 
the  operator  actions  or  lowest  level  event.  Then  the  system  component  nodes  were  identified, 
which  are  based  on  the  understanding  of  the  system.  Next  nodes  were  identified  and  grouped 
after  a  detailed  analysis  of  operator  function  was  made.  Two  groups  of  nodes  were  determined; 
operator  actions  and  system  components.  The  first  group  of  nodes,  operator  actions,  is  a 
collection  of  operator  actions  undertaken  to  accomplish  a  control  function.  These  function  nodes 
are  the  mechanism  the  OFM  uses  to  interpret  or  explain  sequences  of  model  outputs.  The  second 
group  of  nodes,  system  components,  represents  a  set  of  modules  whose  status  is  often  considered 
together  in  operator  decision-making.  These  nodes  make  up  several  levels  of  the  model  and  the 
number  of  levels  needed  was  detennined  by  the  information  gathered.  From  here  the  next  state 
transitions  were  determined  based  on  the  input  nodes,  rank,  arrangement  of  levels  according  to 
input  priority,  and  meaning  of  the  individual  effects  of  state  values  for  an  input  node  at  each 
level  in  the  diagram.  The  input  nodes  constrain  the  state  of  the  receiving  nodes.  After  the  next 
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state  transitions  are  defined,  then  the  model  is  created  using  the  nodes  and  the  information  about 
which  nodes  were  inputs  to  other  nodes.  Then  the  representation  of  the  OFM  was  completed. 

Some  similarities  between  mission  OFMs  were  identified,  because  of  the  nature  of  the  tasks. 
Within  three  of  the  OFMs  (CIED  -  Route  Scan,  CIED  -  Rural  Scan  and  POL)  four  main 
functions  were  identified.  These  functions  were  communication,  mapping,  scanning  and 
observing  historical  data.  Additionally,  sub-functions  within  communication  and  observing 
historical  data  were  identical  for  these  three  models.  Mapping  and  scanning  sub-functions  were 
unique  to  the  task  at  hand.  Actions  were  the  same  for  all  the  missions  and  included  reporting  to 
the  customer,  tasks  for  final  report,  and  communicating  with  other  analysts  for  additional  help. 

CIED:  Route  Scan  OFM:  Figure  3  illustrates  an  OFM  for  the  CIED  mission  described  in 
Section  4.5.1.  As  seen  below,  the  goal  of  the  route  scan  is  to  search  a  route  with  defined  start 
and  end  points  for  indications  of  IED  emplacement. 


Goal 


Functions 


Find  Indicators  of  IED  Placement:  Route  Scan 


New  Information- 


New Information  New  Information 


New  Information 


Inspect  markers 


Report 


Figure  3:  OFM  for  CIED  Route  Scan 
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CIED  -  Rural  Scan  OFM:  Figure  4  is  an  OFM  for  the  CIED  mission  described  in  Section 
4.5.2.  As  shown  below,  the  goal  is  to  find  indications  of  IED  emplacement  within  a  rural  area. 
Indicators  and  cues  are  noticeably  more  complex  than  in  the  route  scan  mission  and  include  more 
behavioral  intelligence  factors  as  well. 


Goal 


Functions 


Find  Indicators  of  IED  Placement:  Rural  Scan 


Figure  4:  OFM  for  Rural  Area  CIED  Sweep 

Threat  to  Convoy  OFM:  Figure  5  is  an  OFM  for  the  CIED  mission  described  in  Section  4.5.3. 
As  shown  below,  the  goal  is  to  find  indicators  of  potential  threats  including  ambush  attacks  to  a 
convoy  traveling  on  a  planned  route.  Indicators  and  cues  include  anomalous  patterns  of  traffic 
indicating  an  abnormal  reaction  to  the  presence  of  the  convoy. 
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Goal 

Functions 


Locate  Potential  Threats  for  Convoy 


Need  more  information  Customer  Defines 
Specific  Indications 


^n:oc)k  ar~^ 


Scan 


Send  Logged  Events 


Customer  Drfi n es 

Custom4rDefir.es  Specific  Indications 
Specify  Indications 


- 

f  Search  for  Movement  j 


Detected 


Figure  5:  OFM  for  Convoy  Threat  Scan 


POL  OFM:  Figure  6  is  an  OFM  for  the  PO:  mission  described  in  Section  4.5.4.  As  shown 
below,  the  goal  is  to  find  indications  of  anomalous  behavior.  Indications  and  cues  may  evolve 
over  the  course  of  the  mission  to  include  tracking  suspicious  activity  discovered  previously  in  the 
mission. 
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Actions 


Figure  6:  OFM  for  POL  Mission 
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OFM-COG:  The  OFM-COG  Model  created  was  based  off  of  Lee  &  Sanquists’  (2000)  proposed 
model  format.  This  in-depth  form  of  modeling  applies  cognitive  agent  tasks  directly  to  the 
functions  and  sub-functions  that  are  represented  in  the  OFM.  The  first  step  in  the  OFM-COG 
table  development  was  to  map  the  generalized  information  processing  task  functions  from  Miller 
(1974)  to  the  tasks  that  are  conducted  by  the  IA.  This  table  is  shown  in  Appendix  A. 

Next  the  human  information  processing  resources  were  applied  to  the  appropriate  function/sub- 
function  based  on  the  cognitive  agent  tasks  identified  within  the  CTA.  The  application  of  the 
human  information  processing  resources  was  based  on  work  by  Lee  &  Sanquist  (2000).  They 
defined  which  resources  were  in  conjunction  with  each  cognitive  agent  task  from  Miller’s  (1974) 
taxonomy.  This  is  shown  in  Table  2  in  Appendix  A.  The  table  is  based  on  Lee  &  Sanquist’s 
(2000)  work  and  altered  for  the  application  to  IA  tasks. 

The  next  step  in  the  development  of  the  OFM-COG  tables  was  to  define  task  and 
environmental  demands  an  IA  might  encounter  during  a  mission.  Table  2  shows  a  preliminary 
list  of  possible  task  and  environmental  demands  associated  with  IA  tasks. 
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Table  2:  Task  and  Environmental  Demands 


Task  and  Environmental  Demands 

Rates  of  Change  (in  feeds) 

Activity  Levels 

Visibility 

Competing  watch  windows/NAIs/EEIs 

Number  of  Targets 

Competing  chat  rooms 

Salience 

Number  of  Sensor  Cues 

Quality  of  Image 

Expertise 

Quality  of  Communication  Feed 

Knowledge 

Time  Constraints 

Vigilance 

Computational  aid 

Situation  Awareness 

Display  Representation 

Expectations 

Landmarks 

Competing  Transmissions 

Shadows 

Physical  Task 

Patterns/shapes 

Visual  Competition 

This  list  was  developed  based  on  interview  information  and  OFM  analysis.  These  task  and 
environmental  demands  were  then  applied  to  the  appropriate  functions/sub-functions,  in  which 
an  IA  might  encounter  them. 

In  addition  to  attributes  of  cognitive  operations,  the  OFM-COG  developed  in  this  research 
captured  additional  domain-specific  data.  Lee  &  Sanquist’s  (2000)  model  format  was  further 
augmented  in  this  work  to  document  the  cognitive  heuristics  and  biases  used  in  perfonning  the 
IA  activities.  The  information  processing  resources,  related  task  and  environmental  demands, 
and  specific  information  related  by  the  analysts  during  interviews  was  used  to  determine  which 
cognitive  biases  most  influenced  cognitive  processes  and  decision  making  as  related  to  the 
cognitive  agent  tasks  in  IA  mission  scenarios.  Table  3  is  based  off  the  work  of  Tversky  & 
Kahneman  (1974),  and  shows  the  relevant  cognitive  biases,  their  description  and  the  cognitive 
heuristic  associated  with  them. 
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Table  3:  Relevant  Cognitive  Biases 


Tversky  &  Kahneman 
Related  Heuristic 

Bias 

Description 

Availability 

Imaginability 

An  event  that  is  easily  imagined  is  judged  to  be  more 
probable 

Saliency 

The  tendency  to  focus  on  the  most  notable  factors  rather 
than  the  most  relevant 

Recall 

An  event  may  seem  more  probable  if  an  instance  is 
easily  recalled 

Search 

An  effective  search  strategy  may  make  an  event  seem 
more  frequent 

Representativeness 

Base  rate 

When  other  data  are  available  the  base  rate  is  ignored 

Anchoring  and  Adjustment 

Confirmation 

Confirming,  rather  than  disconfirming,  evidence  is 
sought 

Redundancy 

Redundant  data  may  cause  undue  confidence  in  its 
accuracy  and  importance 

Selectivity 

Expectation  of  the  nature  of  an  event  influences  what 
information  is  thought  to  be  relevant 

Order 

Undue  importance  may  be  placed  on  the  first  or  last  data 
point 

Complexity 

Perceived  task  complexity  may  be  increased  by  time 
pressure  and  information  overload 

Then  based  on  OFM  analysis  and  analyst  reports,  cognitive  biases  were  identified  for  each 
cognitive  agent  task  used  in  the  cognitive  task  analysis.  Table  4  shows  the  cognitive  biases 
associated  with  each  cognitive  agent  task  and  the  explanation. 
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Table  4:  Salient  Cognitive  Biases  for  Specific  Cognitive  Agent  Tasks 


Cognitive 
Agent  Task 

Cognitive  Bias 

Explanation 

Input  Select 

Saliency,  Imaginability, 
Order 

The  order  in  which  cues  are  presented  may  impact  the 
saliency  of  the  cue  or  how  easily  it  can  be  brought  to  mind. 

Filter 

Redundancy,  Base  Rate, 
Search,  Complexity 

IA  may  eliminate  redundancy  and  may  lose  relevant 
frequency  or  base  rate  of  message  from  the  number  of  cues. 

Detect 

Redundancy,  Base  Rate, 
Search,  Complexity 

IA  may  eliminate  redundancy  and  may  lose  relevant 
frequency  or  base  rate  of  message  from  the  number  of  cues. 

Identify 

Confirmation,  Recall 

Once  an  object  or  entity  is  identified,  then  the  IA  tends  to 
ignore  information  that  is  inconsistent  with  this.  Recent 
events  impact  how  cues  are  identified. 

Code 

Redundancy,  Base  Rate, 
Search,  Complexity 

In  recoding,  IA  may  eliminate  redundancy  and  may  lose 
relevant  frequency  or  base  rate  of  message  from  the  number 
of  cues. 

Store  in 

Buffer 

Recall,  Search 

Patterns  from  variations  (of  size  and  type)  in  stored  messages 
impact  heuristics  in  use  of  the  information  to  make  decisions. 

Compute 

Imaginability,  Recall, 
Similarity,  Correlation 

IA  uses  cues  to  answer  the  EEI,  may  use  Short  Term 

Memory  or  Long-Term  Memory  (learned  patterns). 

Note  that  not  all  biases  occur  in  each  instance  of  a  cognitive  agent  task  and  more  than  one  may 
be  influencing  decision  making  simultaneously. 


An  example  of  constructing  an  OFM-COG  table  for  a  function/sub-function  set  is  the  assignment 
of  the  cognitive  agent  Decide/Select  task  to  the  Mapping/Use  IR  to  Compare  Images  function. 

To  Decide/Select  is  to  “choose  a  response  to  fit  the  situation”  (Fleishman,  Quaintance,  & 
Broedling,  1984).  The  OFM  in  Figure  3  shows  the  input  as  the  AOI  (imagery  data)  and  the 
output  response  alternatives  are  1)  call  to  customer  if  anomaly  is  detected  or  2)  continue 
scanning  imagery  data  if  no  change.  This  is  illustrated  in  Table  5. 
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Table  5:  Working  OFM-COG  for  Sample  OFM 


Mapping/  Change  Sensor  to  IR 

Cognitive 

Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

Pay  attention  to 
imagery  data 

Selective 

attention 

Filter  out  rest 
of  possible 
visual 
distractions 

Salience,  Rate  of 

Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

Filter  out  rest 
of  possible 
visual 
distractions 

Selective 

attention 

Determining  if 
mapping  can  be 
accomplished 
using  current 
visual  feed 

Quality  of  Feed, 
Visibility,  Salience, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise,  Expectations 

Detect 

Determining  if 
mapping  can 
be 

accomplished 
using  current 
visual  feed 

Perceptual 

sensitivity 

Recognize  cues 
for  accurate 
mapping 

Expertise,  Expectations 

Distributed 

attention 

Search 

Search  for  cues 
for  accurate 
mapping 

Sustained 

attention 

Recognize  cues 
for  accurate 
mapping 

Salience,  Visibility, 
Activity  Levels, 
Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Recognize 

uncertainty 

Identify 

Recognize  cues 
for  accurate 
mapping 

Perceptual 

discrimination 

Change  to 
different  visual 
feed  format 

Expertise,  Number  of 
Cues,  Rates  of  Change 
in  Feed,  Situation 
Awareness 

Recognize 

uncertainty 

Long-term 

memory 

Change  to 
different  visual 
feed  sensor 

Working 

memory 

Control 

Change  to 
different  visual 
feed  sensor 

Response 

precision 

Choose IR 

sensor 

Expertise,  Visibility, 
Quality  of  Feed,  Rate  of 
Change,  Expectations 

Decide/Select 

Choose IR 

sensor 

Long-term 

memory 

Expectations  of 
IR  format 

Number  of  Competing 
Feeds,  Amount  of 
Activity,  Expertise, 
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Visibility,  Quality  of 
Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

Plan 

Expectations  of 
IR  format 

Working 

memory 

Responding  to 
uncertainty  in 
mapping 

Expectations,  Expertise 

Processing 

strategy 

Adapt/Learn 

Responding  to 
uncertainty  in 
mapping 

Long-term 

memory 

Efficient 
mapping  to 
complete 
mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

Using  all 
resources  to 
accurately  map 
visual  feed 

Goal  image 

Efficient 
mapping  to 
complete 
mission 

Long-term 

memory 

Use  IR  sensor 
for  successful 
mission 

Quality  of  Feed, 

Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise,  Expectations, 
Knowledge 

Using  all 
resources  to 
accurately  map 
visual  feed 

Processing 

strategy 

27 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


4.0 


RESULTS 


4.1  Validation  of  Models 

Validation  is  also  important  in  experimentation,  including  cognitive  modeling  and  in  particular 
the  OFM.  Muller  and  Narayanan  (2009)  validated  their  research  by  including  a  panel  of  experts 
in  their  evaluation  process.  These  experts,  who  had  no  knowledge  or  experience  with  the 
specific  model  that  was  used,  were  able  to  assess  the  model  on  its  content,  without  any  bias.  In 
Muller  and  Narayanan’s  study,  the  experts  viewed  the  data  collected  and  gave  input  on  the  OFM 
developed.  They  based  this  off  of  a  percentage  of  the  experts’  reviews  and  edited  the  OFM 
accordingly. 

4.1.1.  SME  Validation 

Validation  of  the  developed  models  was  a  SME  panel  process.  Three  SMEs  were  given  a  copy 
of  all  the  OFMs  one  at  a  time.  An  infonnal  interview  and  CW  of  each  OFM  was  conducted. 

Both  individual  and  group  suggestions  were  recorded.  Then  the  SMEs  were  given  a  copy  of  the 
Task  &  Environmental  Demands.  Additions  and  corrections  were  addressed  based  on  the  current 
list. 

Three  SMEs  with  intelligence  experience  were  interviewed  for  validation  purposes.  The  first 
expert  had  32  years  of  intelligence  work  and  one  year  intelligence  imagery  work.  The  second 
expert  was  a  past  aerospace  engineer  with  32  years  government  work  and  a  year  of  intelligence 
imagery  work.  The  third  expert  had  33  years  intelligence  work  experience  and  38  years 
specialized  intelligence  imagery  work.  The  following  section  describes  the  input  and  revisions 
suggested  by  this  SME  panel. 

4.1.2.  SME  Validation 

This  section  will  outline  the  reported  changes  that  need  to  be  included  in  the  final  validated 
models  as  per  the  SMEs. 

Changes  to  all  OFMs  as  reported  by  SMEs  included: 

•  Add  “walking  up  page”  to  Scan  Left/Right 

•  Calls  outs  may  not  be  shared  with  customer  (EMM  decides) 

•  Lead  analyst/EMM  passes  of  responsibility 

•  Watch  Windows  given  to  another  analyst  when  significant  report 

•  Tracking  usually  in  FMV  if  available 

•  Stop/Pause/Fast  Forward/Rewind  function  available  if  something  missed 

•  Add  shadows  to  determine  object  vs.  person,  position  of  object/person,  and 
identifying  object 

•  “When  created”  construction  or  destruction 

•  Add  zoom  to  scanning  process 

•  Add  pass  off  other  watch  windows  when  determined  significant  or  reported  to 
EMM 

•  Add  ask  other  analyst  for  advice  when  detennining  significance 
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Additional  comments  by  SMEs: 

•  IR  sensor  not  used  during  daylight 

•  Military  vehicle  present  vs.  absent  is  a  significant  cue 

•  Tracking  cars  is  more  difficult  using  FMV  than  WAMI 

>  Traffic  is  a  major  factor 

•  Resolution  and  quality  of  feed 

>  Grayscale  vs.  color 

>  Easy  to  categorize  objects  if  imagery  in  color  (ex:  “red  car”  vs.  “car”) 

>  Clarity  is  an  issue 

Route  Scan  -  CIED  OFM:  Changes  to  the  Counter-IED  Route  Scan  OFM: 

•  IR  definitely  used  freshly  dug  up  dirt  big  cue  under  ‘Use  IR  to  Compare  Images’ 

•  Field  of  View  difficult  for  this  task 

•  Is  everyone  moving  to  side  of  road  under  ‘Check  Human  Activity’ 


Figure  8:  Final  OFM  for  CIED  Route  Scan 
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Rural  Scan  -  CIED  OFM:  The  change  specific  to  the  CIED  Rural  Scan  OFM  was  to  add  the 
presence  of  animals  to  the  POL  detail  section. 

Figure  9  reflects  this  change  by  bolded  and  underlined  text. 


Find  Indicators  of  IED  Placement:  Rural  Scan 


Figure  9:  Final  OFM  for  Rural  Area  CIED  Sweep 
Convoy  OFM:  Changes  to  the  Convoy  Monitoring  OFM  are 


•  Add  open  environment  under  ‘Search  for  Terrain  Cues’ 

•  Add  terrain/vegetation  masking  under  ‘Search  for  Terrain  Cues’  and  ‘Ambush 
Cues’ 

•  Urban  AOI  harder  because  of  dense  activity 

•  Wooded/forest  area  harder  to  follow  by  aircraft  and  I A 

Figure  10  is  the  final  validated  OFM  for  the  Convoy  Threat  Scan  mission  with  the  changes 
above  shown  by  bolded  and  underlined  text  within  the  model. 
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Locate  Potential  Threats  for  Convoy 


Need  more  information 


Customer  Dairies 
Specific  Indications 


Customer  Defines. 
Specific  Indications 


Send  Logged  Events 


Uncertain/Missed 

Cues  — 


Specific  Pattern 
Cues 


Detected 


Figure  10:  Validated  OFM  for  Convoy  Threat  Scan 
POL  OFM:  Changes  to  the  POL  OFM  are 

•  Add  speed  of  movement  (adults  running)  in  conjunction  with  military  vehicle 
before  or  after  next  to  body  language  in  cultural  norms 

•  When  scanning  IA  always  needs  to  understand  the  context 

•  Rewind  to  find  origin  of  a  vehicle  when  tracking 


Figures  1 1  and  12  reflect  these  changes  by  bolded  and  underlined  text. 
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Figure  11:  Final  OFM  for  POL  Mission 
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Figure  12:  Detailed  Portion  of  OFM  for  PO:  Mission 

COG  Table  Synthesis:  All  of  the  OFM-COG  tables  were  edited  due  to  SMEs  validation 
interviews.  Because  of  the  additions  in  the  OFMs,  there  were  supplementary  OFM-COG  tables 
needed  to  complete  analysis.  Corrections  in  OFMs  resulted  in  changes  in  the  OFM-COG  tables 
as  well.  As  a  result  of  the  modifications  to  the  OFMs,  the  updated  OFM-COG  tables  are  shown 
in  Appendix  B. 

In  addition  to  edits  to  inputs,  steps,  and  outputs  in  the  OFM-COG  tables  the  SMEs  identified 
additional  Task  and  Environmental  Demands  that  are  key  factors  in  imagery  analysis. 

Reported  additional  Task  and  Environmental  Demands: 

•  Cloud  cover/weather  conditions 

•  Stress/anxiety  from  fear  of  missing  something 

•  Mental  demands 

•  Personal  judgment 

•  Edge  of  FOV-makes  tracking  difficult 

•  On  the  job  training 

•  Sensor  availability 

The  final  list  of  validated  Task  and  Environmental  Demands  is  shown  in  Table  6.  Additions  to 
the  list  are  represented  with  bolded  text. 
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Table  6:  Final  Validated  Task  &  Environmental  Demands  for  OFM-COG  Tables 


Task  &  Environmental  Demands 

Rates  of  Change  (in  feeds) 

Visibility 

Number  of  Targets 

Salience 

Quality  of  Image 

Quality  of  Communication  Feed 

Time  Constraints 

Computational  Aid 

Display  Representation 

Landmarks 

Shadows 

Patterns/Shapes 

Activity  Levels 

Competing  Watch  Windows/NAIs/EEIs 

Competing  Chat  Rooms 

Number  of  Sensor  Cues 

Expertise 

Knowledge 

Vigilance 

Situation  Awareness 

Expectations 

Competing  Transmissions 

Physical  Task 

Visual  Competition 

Stress  from  Fear  of  Missing  Information 

Mental  Demands 

Weather 

Personal  Judgment 

Edge  of  FOV 

On  the  Job  Training 

Sensor  Availability 

SMEs  also  reported  that  general  stress  plays  a  key  role  in  performance  because  analysts  are  put 
into  tense  environments  when  conducting  missions.  The  analysts  are  relocated  to  a  completely 
new  and  different  atmosphere,  in  which  they  endure  dramatic  lifestyle  changes.  This  can  affect 
IA  performance  overall. 

4.2  Results  Summary 

This  section  outlined  the  results  of  the  report,  mainly  the  data  validation  and  the  final 
development  of  the  cognitive  models.  The  next  section  will  dive  into  a  more  detailed 
explanation  of  the  final  models  and  how  measures  of  imagery  analysis  performance  can  be 
obtained  from  these. 
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4.3  Discussion 

4.3.1.  Detailed  Explanation  of  Models 

The  models  developed  help  to  answer  the  research  questions  stated  in  Section  3.1.  These 
questions  were;  ‘What  are  the  cognitive  challenges  associated  with  imagery  analysis?’,  ‘How  do 
we  measure  the  challenges  of  the  tasks  associated  with  imagery  analysis?’  and  ‘Can  we  develop 
a  model  that  addresses  these  challenges  and  identifies  potential  aids  in  the  process?’  The  OFM 
represented  the  independent  and  dependent  tasks  associated  with  IA  missions  and  the  OFM-COG 
was  used  to  compare  the  cognitive  challenges  for  those  tasks.  Furthermore,  the  OFM-COG  was 
not  only  able  to  identify,  but  also  track  the  cognitive  load  of  the  IA.  By  creating  the  OFM  and 
OFM-COG  specific  to  the  IA,  the  tasks  performed  and  cognitive  resources  utilized  to  complete 
those  tasks  are  directly  linked  in  an  easily  understood  format.  This  process  was  described  by  Lee 
&  Sanquist  (2000)  as  .  .bridging  the  gap  between  an  engineering  model  of  the  system  and  a 
psychological  model  of  the  operator. . 

Through  examination  of  the  OFM-COG  tables,  the  cognitive  load  can  be  assessed  for  the 
specific  mission  type.  The  analysis  of  the  OFM-COG  began  with  determining  the  frequency  of 
occurrences  of  the  information  processing  resources  for  each  of  the  main  functions 
(Communication,  Mapping,  POL  Scanning,  Scanning,  and  Tracking)  within  each  of  the  OFMs. 
Table  7  shows  the  results  for  the  sub-functions  under  the  Tracking  function  of  the  Patterns  of 
Life  OFM-COG. 


Table  7:  Frequency  of  Information  Processing  Resource 


Human  Information 
Processing  Resources 

#  of  Occurrences 

Long-term  Memory 

18 

Working  Memory 

15 

Processing  Strategy 

15 

Selective  Attention 

12 

Perceptual  Sensitivity 

8 

Response  Precision 

6 

Sustained  attention 

5 

Perceptual  Discrimination 

4 

Distributed  Attention 

i 

This  demonstrates  the  most  frequent,  and  in  turn  most  significant,  processing  resources  used  by 
the  IA.  Resource  utilization  analysis  was  part  of  the  strategy  for  identifying  cognitive  challenges 
and  detecting  critical  decision  points.  These  points  are  where  biases  and  heuristics  may  be  used 
unintentionally  by  IAs  for  analytic  judgment.  From  this  analysis,  it  is  clear  that  memory, 
strategy  and  selective  attention  are  key  resources.  Design  recommendations  on  potential  aids  in 
managing  these  resources  are  discussed  in  Section  8.1. 

An  additional  analysis  on  the  Task  and  Environmental  Demands  within  the  OFM-COG  tables 
was  conducted.  Table  8  below  shows  the  frequency  breakdown  of  these  demands  within  the  sub¬ 
functions  of  the  Tracking  function  from  the  POL  OFM-COG. 


35 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


Table  8:  Occurrences  of  Task  and  Environmental  Demands 


Task  and 

Environmental  Demands 

#  of  occurrences 

Expertise 

41 

Rate  of  Change  in  Feed 

20 

Activity  Levels 

20 

Number  of  Cues 

19 

Visibility 

18 

Expectations 

16 

Salience 

13 

Knowledge 

13 

Quality  of  Feed 

12 

Competing  Watch  Windows  or  Feeds 

8 

Time  Constraints 

8 

Number  of  Competing  Feeds 

6 

Situation  Awareness 

4 

Computational  Aid 

4 

This  table  points  to  the  most  significant  task  and  environmental  demands  (based  on  frequency) 
placed  upon  the  IA.  The  most  frequent  demand  is  expertise,  which  is  to  be  expected,  but  the 
other  more  frequent  demands  relate  to  the  feed  content.  This  is  an  indicator  of  management  for 
the  volume  of  information  collected  by  imagery  sensors.  However,  analysts’  reports  were  in 
terms  of  levels  of  human  activity,  not  in  terms  of  the  sensors.  Focus  should  be  placed  on 
capturing,  manipulating,  and  exploiting  observations  of  human  activity  and  complex  events 
unfolding  within  the  imagery.  Other  important  concepts  that  can  be  derived  from  this  analysis 
are  geospatial  and  motion  imagery  manipulation  capabilities,  which  are  present  in  current 
systems  but  not  utilized  (as  based  on  analyst  reports). 

The  cognitive  models  developed  were  analyzed  to  identify  different  cognitive  demands  in  FMV 
and  WAMI  analysis.  Further  analysis  has  been  conducted  of  the  OFM  and  OFM-COG  tables, 
which  provides  the  basis  for  producing  cognitive  measures  in  persistent  surveillance. 

4.3.2.  Measures  of  Performance  &  Effectiveness 

The  main  product  through  the  analysis  of  the  cognitive  models  is  the  generation  of  possible 
measures  that  impact  IA  performance. 

Initial  metrics  that  have  been  acknowledged  include: 

•  Area  of  AOI 

•  Density  of  AOI 

•  Specificity  of  target  (if  mission  is  target  search) 

>  Number  of  features  given  by  customer 

>  Amount  of  historical  data  available 

•  Number  of  repetitions  of  information  processing  resources  in  OFM  cycle  that  are 
not  aided 

•  Confidence  in  what  the  IA  is  reporting 
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•  Level  of  detail  in  reporting  (i.e.  does  the  IA  have  the  support  to  store  all  the  cues 

and  information  needed  or  do  they  have  to  filter  and  purge  prematurely) 

A  concept  for  a  DSS  that  alleviates  the  cognitive  demands  for  IA  decision  making  processes  is 
discussed  in  the  following  section. 
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5.0  CONCLUSION 

5.1  Research  Conclusion 

This  research  has  focused  on  studying  how  real-time  motion  imagery  intelligence  missions  are 
performed,  and  what  cognitive  demands  arise  from  persistent  surveillance.  The  models 
presented  here  work  together  to  identify  cues  and  cognitive  demands  of  the  IA.  These  models 
and  associated  OFM-COG  tables  allow  us  to  visualize  cognitive  heuristics  that  the  IA  uses  and 
their  associated  biases  that  directly  impact  decision  making.  The  models  also  identify  decision 
points  in  the  mission  that  directly  leads  to  errors  that  can  occur.  And  lastly  these  cognitive 
models  enable  designation  of  metrics  by  which  success  can  be  measured.  Based  on  this  analysis 
metrics  can  be  identified  for  success/errors  and  these  metrics  can  be  applied  directly  to  IA 
performance  and  training. 
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6.0  RECOMMENDATIONS 

The  design  recommendations  and  concepts  in  the  following  sections  were  a  result  of  a 
collaborative  effort  with  Radiance  Technologies  in  Dayton,  Ohio. 

6.1  Design  Recommendations 

Through  analysis  of  the  cognitive  models  the  most  significant  demands  were  memory  and 
strategy.  This  can  be  applied  to  all  of  the  functions  that  were  represented  in  the  OFMs,  for 
example  the  Communication  or  Tracking  functions. 

Some  missions  requiring  real-time  support  will  place  the  processing,  exploitation  and 
dissemination  (PED)  cell  in  direct  contact  with  the  customer.  In  these  cases,  the  intelligence 
team  must  be  able  to  collaborate  in  real-time.  Because  of  this,  there  will  be  an  increased  need  to 
provide  informal  information  sharing.  Current  informal  methods  favor  broadcast  “shout  outs” 
over  peer-to-peer  chat  rooms.  However,  untargeted  broadcast  methods  are  not  scalable  to  large 
teams  with  distinct  objectives. 

This  vision  of  distributed  ISR  operations  gives  us  some  concepts  of  the  requirements  for  a 
WAMI  exploitation  tool  that  can  be  integrated  into  an  ISR  system: 

7.0  Facilitation  of  real-time  reporting. 

8.0  Aggregation  of  multiple  individual  event  reports  to  present  “big  picture”  issues 
9.0  Structuring  data  to  be  useful  in  further  analysis. 

The  requirement  to  structure  observations  of  WAMI  data  is  in  conflict  with  the  requirement  to 
provide  real-time  reporting.  In  interviews,  all  FMV  analysts  reported  that  during  real-time 
operations,  they  would  provide  informal,  unstructured  reports  via  voice  or  chat  message,  and 
then  created  a  structured  report  after  the  mission  was  over.  This  is  not  a  plausible  approach 
during  WAMI  exploitation.  Therefore,  a  concept  for  capturing  a  minimal  set  of  structured  data 
in  a  way  that  requires  as  little  input  from  the  analyst  as  possible  is  proposed. 

Elements  of  information  for  the  construction  of  an  event  report  include  the  geospatial  and 
temporal  data  that  can  be  entered  via  a  single  user  action  within  the  data  viewer  (i.e.  cursor  on 
target).  However,  FMV  analysts  interviewed  in  support  of  this  effort  indicated  that  they  used  a 
semi-structured  language  in  making  chat  room  call  outs.  This  served  to  structure  event  reports  in 
a  uniform  way  using  agreed-upon  terms  from  operations  verbiage.  This  jargon  does  not  establish 
a  complete  semantic  definition  of  the  elements  of  reporting,  but  it  does  point  to  the  fact  that 
specific  requested  EEIs  are  answered  in  standardized  ways  by  the  analysts.  Thus,  a  user- 
centered  display  interface,  could  provide  templates  for  reporting  against  specific  EEIs  such  as 
potential  convoy  ambush  locations,  suspicious  vehicles,  potential  IED  threats,  etc.  Figure  13 
shows  the  notional  User  Interface  (UI)  for  event  management  with  callouts  to  relate  design 
aspects  to  the  results  of  the  cognitive  task  analysis  described  earlier. 
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Details 

Event  Chip 

Location  0 

00  00  00'N  000  00  OO'  E 

_  Follow  Up  In;  Tracking  Timeline: 

Report  to  Chat  .  .  ■ — .  - » 

Immediately  5  minutes  *  Timeline  3  * 

00  00  Z/  00  00  Local 
End  Time  /  0 

0000  2  /  00:00  Local  OK  Caned 


Figure  13:  Notional  UI  for  event  “Call-Out” 

The  proposed  concept  provides  decision  support  for  the  IA  in  various  forms.  The  OFM-COG 
table  shows  the  cognitive  agent  tasks  that  the  IA  engages  in,  utilizing  high  levels  of  cognitive 
resources,  which  can  be  alleviated  through  this  concept.  More  specifically,  the  IA  is  required  to 
temporarily  save  information  in  their  short-term  memory  ( Store  in  Buffer  cognitive  agent).  This 
information  varies  in  message  size  and  type,  and  when  patterns  emerge,  this  information  is  used 
with  the  cognitive  heuristics  to  make  decisions.  The  UI  reduces  the  load  on  short-term  memory, 
frees  up  cognitive  resources  and  thereby  reduces  the  likelihood  cognitive  biases  impacting  the 
decision  making  process  of  the  IA. 

The  UI  concept  in  Figure  13  also  aids  in  the  Code  task,  in  which  the  I A  translates  what  is  seen  or 
read  into  a  format  for  reporting.  As  seen  from  the  interviews,  this  translation  is  an  expected 
process  and  can  distinguish  a  novice  from  a  more  experienced  analyst.  The  UI  would  aid  in 
keeping  meaning  intact  and  may  eliminate  redundancy  in  the  information  that  could  cause  the  IA 
to  incorrectly  make  a  judgment  based  on  frequency.  The  UI  concept  also  reduces  the  sustained 
attention  required  to  perform  the  Search  cognitive  task  by  sequencing  the  set  of  entities,  which 
may  include  an  image,  part  of  an  image,  other  databases,  or  other  interface  elements,  for  inquiry. 

In  interviews  FMV  analysts  accustomed  to  doing  “call  out”  reporting  for  real-time  operations  did 
not  filter  their  reports;  if  they  observed  activity  that  might  be  relevant  to  their  EEIs,  they  reported 
immediately  and  supported  their  report  with  reasons  why  the  activity  might  be  relevant.  Again, 
this  is  not  an  approach  that  is  applicable  to  WAMI  exploitation.  Tools  are  needed  to  allow 
analysts  to  multitask,  monitor  multiple  events  within  the  AOI,  and  to  track  events  over  time, 
allowing  the  initial  detection  to  be  captured  along  with  subsequent  observations  to  confirm  or 
deny  significance.  Some  EEIs  such  as  imminent  threats  will  always  require  immediate  reporting 
though.  Therefore,  a  system  of  dual  event  stacks  is  proposes  to  separate  events  by  their  reporting 
status  as  shown  below  in  Figure  15. 


40 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-2013-5113;  Cleared  04  December  2013 


Figure  14:  Notional  DSS  Relating  to  Results  of  Cognitive  Modeling 

The  left  stack  is  intended  to  hold  new  and  emerging  events  that  require  monitoring  but  that  the 
analysts  is  not  ready  to  report.  The  right  stack  is  planned  to  hold  already  reported  (in  real-time 
chat  form)  emerging  events  that  have  higher  operational  priority.  Also,  completed  events  can  be 
deleted  from  the  stacks  and  inactive  events  can  be  collapsed  until  needed. 

In  Figure  15,  the  timeline  of  events  is  given  a  significant  portion  of  the  display  area.  This 
timeline  is  not  just  a  summary  of  the  existence  of  events;  it  is  a  part  of  the  exploitation 
environment.  During  interviews,  FMV  analysts  reported  that  they  did  not  multitask.  This  is 
because  as  FMV  analysts  they  do  not  support  multiple  simultaneous  missions  or  view  multiple 
fields  of  view.  Again,  WAMI  exploitation  requires  a  different  approach.  A  timeline  view 
divided  into  swim-lanes  is  more  applicable  to  WAMI  analysis;  allowing  analysts  to  organize 
events  into  categories  or  sequences.  This  will  allow  analysts  to  construct  streams  of  indicator 
events  for  pattern  of  life  analysis  and  facilitate  analyst  awareness  of  events  across  multiple 
exploitation  tasks. 

A  few  examples  of  how  an  event-centered  UI  concept  reduces  load  on  cognitive  resources  using 
load  profile  information  extracted  from  the  operator  function  model  and  associated  OFM-COG 
table  is  outlined  here.  Table  9  provides  further  details  on  the  design  rationale  for  individual 
elements  of  the  display.  The  numbers  depicted  within  the  circles  in  Figure  15  map  to  the 
description  in  Table  9. 
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Table  9:  Cognitive  Features  of  DSS 


•  Frees  working  memory  for  new  searches. 

•  Leverages  expertise  among  analysts;  novices  can  forward  POLs  to  experts  or  experts  may 
show  novices  examples  requiring  more  experience  to  identify 

•  Improves  saliency  of  POLs  by  visually  “logging”  them  on  the  sides.  Organization  is 
automatic.  Coordinates  do  not  need  to  be  entered.  Both  physical  and  cognitive  load  are 
reduced. 

•  Improves  quality  of  communication  (includes  graphic,  text,  all  pertinent  details)  and 
more  effectively  manages  time  because  it  precludes  the  need  for  “requesting  additional 
eyes”  and  promotes  TeamSpeak  for  follow-up. 

•  Helps  to  maintain  vigilance  among  analysts.  When  they  tire  with  a  single  AOI,  other 
AOIs  may  be  referenced.  Promotes  interactivity  within  the  “state  of  the  world.” 


•  Analysts  often  place  mIRC  next  to  AOIs.  The  timeline  recalls  this  habit.  The  timeline 
aggregates  relevant  events,  improves  long-term  saliency,  and  establishes  an  order  for 
later  reference  (limits  time  bias). 

•  Allows  for  spatially-minded  analysts  to  perform  more  effectively.  The  timeline  is 
essentially  a  second-order  isomoiphism  for  all  relevant  events,  allowing  for  “mental 
travel”  across  events.  These  spatial  orientations  create  visual  handles  for  fast  recall  and 
follow-up. 


•  In  coordination  with  the  timeline,  the  clocks  help  reinforce  situational  awareness  through 
time.  They  also  act  as  decision  aids  in  helping  to  prioritize  long-standing  events. 


•  The  GUI  is  standardized  for  future  studies  of  novice  vs.  expert  behavior. 

•  Intuitive  GUI  leverages  mental  models  of  existing  GUIs. 

6.2  Future  Work 

Further  research  and  concept  development  can  lead  to  a  notional  UI  for  event  management 
among  FMV  and  WAMI  analysts.  Building  on  this  study,  future  work  includes  taking  additional 
measures  to  increase  the  fidelity  of  information  included  in  the  OFM-COG  tables  and  existing 
OFM  models.  Next  steps  would  include  further  investigation  to  develop  and  implement  a  test 
plan  in  validating  the  proposed  measures. 

To  further  develop  the  proposed  conceptual  UI,  additional  technical  development  is  required.  A 
comparative  CTA  study  of  analyst  performance  with  and  without  the  tool  would  validate  the 
utility  and  effectiveness  of  the  concept  for  analyst  use. 
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APPENDIX  A  -  OFM  Cognitive  Operations  Tables  Supporting  Documents 

A.l  Mapping  of  Information  Processing  Task  Functions  to  Imagery  Analyst  Tasks 

The  table  below  represents  a  mapping  of  Miller’s  (1974)  task  functions  involved  in  a  generic 
information-processing  system  to  the  tasks  conducted  by  an  IA.  This  mapping  is  utilized  in  the 
OFM-COG  tables  presented  below. 


Task  Function  Definition  and  Relationship  to  IA  tasking 


Task  Function 

Definition  and  Relationship  to  IA  tasking 

Input  Select 

Selecting  what  to  pay  attention  to  within  the  image,  interface,  other  analyst 
a.  What  are  the  rules: 

i.  Auditory,  visual 

ii.  symbols  and  vocabulary 

iii.  syntax  -  combination  of  cues  that  creates  meaning 

iv.  size  of  chink  of  information  acceptable:  threshold  for  input 
detection 

Filter 

Procedure  for  reducing  or  eliminating  irrelevant  messages  (heuristics  for 
determining  relevancy  of  cue) 
a.  Filtering  device 

i.  Fluman  fdter 

ii.  Automated  machine  filter  -  *design  element* 

Detect 

Discrimination  of  a  cue  requiring  attention  or  action  from  background  “noise” 

a.  Response  lag  for  detection 

b.  Reliability  of  detection  as  relates  to  discriminability 

c.  Scan  patterns  (which  are  more  effective) 

d.  (Cognitive)  heuristics  for  detection 

Search 

Selecting  set  of  entities  for  inquiry  (image,  part  of  image,  other  databases, 
decision  support  system,  other  interface  elements) 
a.  Sequencing  the  set  of  entities 

Identify 

Methods  for  characterizing  a  message”;  “recognize  and  apply  label” 

a.  Reference  outside  processing  system  (where  it  comes  from)  and  physical 
location  (functional)  within  -  how  does  the  IA  cross-reference  these? 

b.  Principles 

i.  Need  additional  information  beyond  what  is  required  for  detection 

ii.  Once  object/entity  is  identified,  then  IA  tends  to  ignore  information 
that  is  inconsistent  with  this  -  confirmation  bias 

iii.  Expectancies  -  recent  events  (recency  bias)  impact  how  cues  are 
identified 

iv.  How  to  assign  identity  labels? 

Message 

Collection  of  meaningful  symbols;  features  are  elements  and  pattern 

a.  Elements:  what  are  the  defined  terms? 

b.  Patterns:  how  does  the  IA  ‘organize’  the  elements  in  an  image/video?  (for 
both  elements  and  pattern) 

c.  Visual  (symbol)  &  Audio  (written  words) 

d.  “smallest  conceptual  unit  of  action  that  produces  a  system  response” 

Queue  to  Channel 

How  to  organize  processing  of  messages 

a.  Can  priority  be  assigned  without  having  to  process  all  message? 
i.  Take  advantage  of  underutilized  channels 
a.  If  get  many  chats  &  few  spoken  messages,  switch  format 

Code 

Translating  what  is  seen/read  into  format  for  reporting 
a.  Intent  to  not  lose  meaning 

46 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


b.  Recoding  may  eliminate  redundancy 

i.  May  lose  relevant  frequency  of  message  from  number  of  cues 

Transmit 

Moving  message  from  one  place  to  another.  Example:  taking  cues  from  image 
and  writing  in  chat  or  transmitting  over  headset 

a.  Generally  follows  parallel  (all  messages  sent  at  once)  transmission 

b.  Bandwidth  -  channel  capacity  to  send  signals 

i.  Human  information  processing  resources 

ii.  Number  of  chat  windows 

iii.  Space  available  in  the  interface 

iv.  Sensor  bandwidth 

Store 

Keeping  something  intact  for  future  use 

a.  Labeling  content,  determining  units  required  (text,  image),  locating 
spacing  (where?);  loading  (how  to  copy  to  storage;  safeguarding 

b.  Memory  required  for  identifying  where  information  stored  may  become 
greater  than  that  needed  for  the  information  itself 

i.  Label  for  associative  memory 

Store  in  Buffer 

Saving  temporarily 

a.  Reduced  load  on  short-term  memory 

b.  Considerations:  variations  in  message  size  and  type 

i.  Patterns  with  impact  heuristics  in  use  of  information  to  make 
decisions 

Compute 

Figuring  out  logical  answer  to  a  defined  problem 

a.  Use  cues  to  process  and  answer  EEI 

b.  Uses  short  term  (from  aids)  and  long  term  (learned  patterns)  memory 

Edit 

Arranging  information  into  a  message  according  to  prescribed  formats 
a.  According  to  IA:  need  to  use  military  jargon 
i.  Use  formatting  of  accepted  reports 

Display 

“Showing  something  that  makes  sense,”  Recording  information  for  reporting 
out 

a.  When  to  use  images  versus  text 

b.  When  to  use  raw  data  versus  applying  an  algorithm 

c.  Manipulate  format  to  aid  heuristics 

d.  When  to  use  symbols  versus  full  content  in  text 

Purge 

Getting  rid  of  unwanted  information 

a.  When  timeline  fills  up  or  IA  has  used  all  available  cognitive  resources, 
how  to  eliminate  unneeded  information  for  more  effective  decision 
making. 

Reset 

Identifying  new  contexts  to  “reset”  (pattern  of  search  or  what  searching  for) 

a.  Update  in  EEI 

b.  Customer  requests  new  set  of  information 

c.  New  information  from  intelligence  changes  course  of  decision  making 

Count 

Keeping  track  of  how  many 

a.  Simple  as  counting  for  slash  count  (how  to  store  and  display) 

b.  Tracking  cues  that  build  to  a  decision 

i.  Adding  elements  of  the  pattern  to  build  decision  support  or 
heuristic  pattern 

ii.  How  do  we  use  this  concept  in  the  timeline? 

Control 

“Changing  an  action  according  to  plan” 

a.  Physical:  manipulating  tools  the  IA  uses 

b.  Symbolic:  source  of  instruction  for  what  happens  next 
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a.  “function  of  coordination  in  time  and  space  according  to  plan” 

b.  Signal  of  status 

c.  Decision 

Decide/Select 

Selecting  an  appropriate  response  to  fit  the  situation” 
a.  Input  condition  matches  response  alternative  and  strategic  rules  for 
selection 

Plan 

Matching  resources  to  expectations 

a.  Rules  for  predicting  future  sets  of  conditions,  responses  needed,  and  order 
of  steps 

i.  Comes  directly  from  interviews  and  should  become  apparent 

through  OFM 

Test 

Rules  for  determining  the  integrity  of  the  signals,  messages 
a.  Signal  test  -  comparing  attributes  of  a  test  signal  with  a  set  of  reference 
values 

a.  Compare  structures/activities/etc.  with  known  or  expected 

Interpret 

What  meaning  can  be  attributed 

a.  Requires  response  to  a  pattern  of  cues 

b.  What  are  the  learned  ‘rules’  for  determining  the  significance/value  of  a 
cue  -  how  does  the  IA  ‘test’  these  for  determination  thereof. 

c.  Do  they  hold  these  references  in  memory,  databases  or  other  decision 
aid/tool? 

i.  How  much  tolerance  do  they  allow  for  determining  whether  a  cue 
is  discarded,  stored  for  future  use,  or  applied  immediately? 

d.  Automatic  recognition  of  a  pattern 

ii.  Heuristics  IA  use 

iii.  Inferences  made  from  input  data  and  other  known  information 

iv.  Variables  in  interpretation 

b.  Degree  of  statistical  certainty  (in  correct  decision) 

c.  Redundancy  in  context  available 

d.  Range  in  variability  of  elements  in  pattern 

e.  Proportion  of  irrelevant  “noise” 

f.  Number  of  alternative  meanings 

g.  Opportunity  for  interpreter  (IA)  to  query  the  source  and 
test  hypothesis 

Categorize 

Defining  and  naming 

a.  Rules  for  classifying  intel  according  to:  source,  format,  purpose  or  content 

b.  Structures  for  information  retrieval 

i.  Information  storage,  decision  aid,  or  memory? 

Adapt/Learn 

Remembering  and  formulating  new  responses  to  a  known,  repetitive  situation 

a.  Modifying  system  behavior  as  a  result  of  experience 

a.  IA  heuristics 

b.  Learning  algorithm  within  the  decision  aid 

b.  Are  information  handling  requirements  and  process  paradigms  relevant? 

Goal  Image 

Picture  of  a  task  done  well 

a.  Criteria  for  ending  a  task 

b.  Serves  as  a  steering  reference  for  moving  through  a  “route  of 
action”  (i.e.  Steps  through  the  OFM) 

c.  Meaningful  operationally  when  system  has  options 

i.  Less  experienced  IA  may  follow  procedures  and  operations  rather 
than  goals  (and  goal  variables) 
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i.  Stress,  fatigue  and  repetition  impacts  goal  image 

1 .  Training  for  tolerance  in  goal  variables  and  to 
make  operator  cognitively  active 


A.2  Information  Processing  Resources  for  IA  Cognitive  Agent  Task  Definitions 


Cognitive  Agent 
Task 

Definition 

Human  Information 
Processing  Resources 

Input  Select 

selecting  what  to  pay  attention  to  within  the  image, 
interface,  other  analyst 

Selective  attention 

Perceptual  sensitivity 

Filter 

reducing  or  eliminating  irrelevant  messages 

Selective  attention 

Detect 

discrimination  of  a  cue  requiring  attention  or  action 
from  background  "noise" 

Perceptual  sensitivity 

Distributed  attention 

Search 

selecting  set  of  entities  for  inquiry 

Sustained  attention 

Perceptual  sensitivity 

Identify 

methods  for  characterizing  a  message 
recognize  and  apply  label 

Perceptual  discrimination 
Long-term  memory 

Working  memory 

Message 

collection  of  meaningful  symbols 

Response  precision 

Queue  to 
channel 

how  to  organize  processing  of  messages 

Working  memory 

Processing  strategy 

Code 

translating  what  is  seen/heard  into  format  for 
reporting 

Response  precision 

Working  memory 

Long-term  memory 

Transmit 

moving  message  from  one  place  to  another 

Response  precision 

Store 

keeping  something  intact  for  future  use 

Working  memory 

Long-term  memory 

Store  in  Buffer 

saving  temporarily 

Working  memory 

Processing  strategy 

Compute 

figuring  out  logical  answer  to  a  defined  problem 

Processing  strategy 

Working  memory 

Edit 

arranging  information  into  a  message  according  to 
prescribed  formats 

Long-term  memory 

Selective  attention 

Display 

showing  something  that  makes  sense 

Response  precision 

Purge 

getting  rid  of  unwanted  information 

empty'  their  minds  of  something  they  determine  not 

important 

Selective  attention 

Reset 

identifying  new  contexts  to  "reset"  procedure 

Selective  attention 

Response  precision 

Count 

keeping  track  of  how  many 

Sustained  attention 

Working  memory 

Control 

changing  an  action  according  to  plan 

Response  precision 

Decide/  Select 

choose  a  response  to  fit  the  situation 

Long-term  memory 

Processing  strategy 

Plan 

matching  resources  to  expectations 
expecting  to  see  something  happening  based  on 
time  or  location 

Working  memory 

Processing  strategy 

Test 

rules  for  determining  the  integrity  of  the  signal  or 

Perceptual  sensitivity 
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message 

determining  if  the  signal  is  there 
determining  if  the  signal  is  real  or  deception 

Working  memory 

Long-term  memory 

Interpret 

what  does  it  mean 

requires  response  to  a  pattern  of  cues 
automatic  recognition  of  a  pattern 

Long-term  memory 

Sustained  attention 

Categorize 

defining  and  naming 

on  a  conscious  level  (may  be  verbal  or  written  into 
the  report) 

Long-term  memory 

Perceptual  sensitivity 

Adapt/Learn 

making  and  remembering  new  responses  to  a 
repeated  situation 

may  be  determinant  upon  the  strength  and  integrity 
of  the  signal/info 

Long-term  memory 

Goal  image 

picture  of  a  task  well  done 

Long-term  memory 

Processing  strategy 
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APPENDIX  B  -  OFM  COGNITIVE  OPERATIONS  TABLES 


B.  1  CIED  -  Route  Scan  OFM-COG  Tables 


Monitor  Chat 
Rooms/ 

Communication 

Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 
communication 

feed 

Selective 

Attention 

new  information 
requires  written  or 
verbal 

communication 
(through  chat 

room  or 

TeamSpeak)  to 
confirm 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

visually  pay 
attention  to  chat 

rooms  instead  of 

video  feed 

Perceptual 

Sensitivity 

Detect 

new  information 
requires  written  or 
verbal 

communication 
(through  chat 

room  or 

TeamSpeak)  to 
confirm 

Perceptual 

Sensitivity 

recognize  and 
label  new 

information 

Expertise, 
Expectations, 
Salience,  Rate  of 
Change  in  Feed 

Distributed 

Attention 

Identify 

recognize  and 
label  new 

information 

Perceptual 

Discrimination 

written  or  verbal 

communication 
(through  chat 

room  or 

TeamSpeak) 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness,  Time 
Constraints 

Long-term 

Memory 
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Working  Memory 

Message 

written  or  verbal 

communication 
(through  chat 

room  or 

TeamSpeak) 

Response 

Precision 

requires 

communication  to 

confirm  new 

information  then 
visual  inspection 

Expertise, 

Knowledge, 

Quality  of  Oral 
Communication, 
Quality  of  Chat 
Room 

Queue  to  Channel 

requires 

communication  to 

confirm  new 

information  then 
visual  inspection 

Working  Memory 

determine  form  of 

communication 
needed  (written  or 
verbal) 

Time  Constraints, 

Computational 

aid,  Activity  Levels, 

Expertise, 

Knowledge, 

Vigilance, 

Situation 

Awareness, 

Expectations 

Processing 

Strategy 

Code 

determine  form  of 

communication 
needed  (written  or 
verbal) 

Response 

Precision 

communicating  in 
correct  format  to 
appropriate 
correspondent(s) 

Aid,  Expertise, 

Knowledge, 

Expectations 

Working  Memory 

Long-term 

Memory 

Transmit 

communicating  in 
correct  format  to 
appropriate 
correspondent(s) 

Response 

Precision 

keep  new 
information  until 
mission  complete 

Quality  of 
Communication 
Feed,  Physical 
Action,  Time 
Constraints, 

Display 

Representation, 

Competing 

Transmissions, 

Expertise, 

Knowledge 
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Store  in  Buffer 

keep  new 
information  until 
mission  complete 

Working  Memory 

plan  for  if  new 
information  is 

confirmed  or  not 

Time  Constraints, 
Activity  Levels 

Processing 

Strategy 

Edit 

use  military  jargon 

Long-term 

Memory 

accurate  account 

of  information  in 

message 

Expertise, 

Knowledge, 

Expectations 

Selective 

Attention 

Display 

accurate  account 

of  information  in 

message 

Response 

Precision 

respond  to  new 
information  by 
communication 

Expertise, 

Knowledge, 

Quality  of 
Communication 
Feed,  Competing 
Transmissions 

Decide/Select 

respond  to  new 
information  by 
communication 

Long-term 

Memory 

plan  for  if  new 
information  is 

confirmed  or  not 

Expertise, 

Knowledge, 

Situation 

Awareness, 

Expectations 

Processing 

Strategy 

Plan 

plan  for  new 
information 

Working  Memory 

processing  new 
information 

Expertise, 

Knowledge, 

Expectations 

Processing 

Strategy 

Adapt/Learn 

processing  new 
information  for 

the  mission 

Long-term 

Memory 

investigate  new 
information  with 

communication 

Expertise, 
Knowledge,  Time 
Constraints, 
Competing 
Transmissions, 
Activity  Levels 

Goal  Image 

investigate  new 
information  with 

communication 

Long-term 

Memory 

using 

communication  to 

confirm  new 

Quality  of 
Communication, 
Activity  Levels, 
Competing 
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information 

Transmissions, 

Expertise, 

Expectations, 

Knowledge 

Processing 

Strategy 

Mapping/Change  Sensor  to  IR 


Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 
visual  feed 

Selective  attention 

filter  out  rest  of 
possible  visual 
distractions 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
possible  visual 
distractions 

Selective  attention 

determining  if 
mapping  can  be 
accomplished 
using  current 
visual  feed 

Quality  of  Feed, 
Visibility,  Salience, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations 

Detect 

determining  if 
mapping  can  be 
accomplished 
using  current 
visual  feed 

Perceptual 

sensitivity 

recognize  cues  for 
accurate  mapping 

Expertise, 

Expectations 

Distributed 

attention 

Search 

search  for  cues  for 
accurate  mapping 

Sustained 

attention 

recognize  cues  for 
accurate  mapping 

Salience,  Visibility, 
Activity  Levels, 
Expertise,  Number 
of  Cues 
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Perceptual 

sensitivity 

recognize 

uncertainty 

Identify 

recognize  cues  for 
accurate  mapping 

Perceptual 

discrimination 

change  to 
different  visual 

feed  format 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

recognize 

uncertainty 

Long-term 

memory 

change  to 
different  visual 

feed  sensor 

Working  memory 

Control 

change  to 
different  visual 

feed  sensor 

Response 

precision 

choose IR  sensor 

Expertise, 

Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 

Decide/Select 

choose IR  sensor 

Long-term 

memory 

expectations  of  IR 
format 

Number  of 
Competing  Feeds, 
Amount  of 

Activity,  Expertise, 
Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 

Processing 

strategy 

Plan 

expectations  of  IR 
format 

Working  memory 

responding  to 
uncertainty  in 
mapping 

Expectations, 

Expertise 

Processing 

strategy 

Adapt/Learn 

responding  to 
uncertainty  in 
mapping 

Long-term 

memory 

efficient  mapping 
to  complete 
mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

using  all  resources 
to  accurately  map 
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visual  feed 

Goal  Image 

efficient  mapping 
to  complete 
mission 

Long-term 

memory 

use  IR  sensor  for 

successful  mission 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

using  all  resources 
to  accurately  map 
visual  feed 

Processing 

strategy 

Mapping/  Determine  Time  Created 


Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 

IR  sensor  data 

Selective 

attention 

filter  out 

irrelevant  visual 

distractions 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out 

irrelevant  visual 

distractions 

Selective 

attention 

search  for 

anomalies  within 

data 

Quality  of  Feed, 
Visibility,  Salience, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations 

Search 

search  for 

anomalies  within 

data 

Sustained 

attention 

recognize  and 
label  anomaly 

Salience,  Visibility, 
Activity  Levels, 
Expertise, 

Number  of  Cues 
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Perceptual 

sensitivity 

Identify 

recognize  and 
label  anomaly 

Perceptual 

discrimination 

process  anomaly 
information 

Expertise, 

Number  of  Cues, 
Rates  of  Change 
in  Feed,  Situation 
Awareness 

Long-term 

memory 

process  of 
anomaly  time 
detection 

Working  memory 

Queue  to  Channel 

process  anomaly 
information 

Working  memory 

save  anomaly 
information  for 

time  detection 

Time  Constraints, 
Computational 
aid,  Activity 

Levels,  Expertise, 

Knowledge, 

Vigilance, 

Situation 

Awareness, 

Expectations 

process  of 
anomaly  time 
detection 

Processing 

strategy 

Store  in  Buffer 

save  anomaly 
information  for 

time  detection 

Working  memory 

figure  out  timing 
of  creation 

Computational 

Aid,  Time 
Constraints 

Processing 

strategy 

Compute 

figure  out  timing 
of  creation 

Processing 

strategy 

focus  on  time  of 
creation  only 

Computational 

Aid,  Time 

Constraints, 

Expertise 

Working  memory 

determine  time  of 

creation 

Purge 

focus  on  timing  of 
anomaly  only 

Selective 

attention 

efficient  data 
analysis  of  time  of 
creation  of  data 
to  complete 

Expertise 
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mission 

focus  on  anomaly 
information 

Decide/Select 

determine  time  of 

creation 

Long-term 

memory 

plan  on  how  to 
determine  time  of 

creation  based  on 

available 

resources 

Number  of 
Competing  Feeds, 
Amount  of 

Activity,  Expertise, 
Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 

Processing 

strategy 

Plan 

plan  on  how  to 
determine  time  of 

creation  based  on 

available 

resources 

Working  memory 

response  to 
anomaly 
detection  in  IR 

data 

Expectations, 

Expertise 

Processing 

strategy 

Adapt/Learn 

response  to 
anomaly 
detection  in  IR 

data 

Long-term 

memory 

efficient  data 
analysis  of  time  of 
creation  of  data 
to  complete 
mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

using  all  resources 
to  accurately 
determine  time  of 

creation  in  data 

Goal  Image 

efficient 

determination  of 

time  creation  of 
data  to  complete 
mission 

Long-term 

memory 

determine  time  of 

creation  for 

successful  mission 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

58 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


using  all  resources 
to  accurately 
determine  time  of 

creation  in  data 

Processing 

strategy 

Mapping/  Visual  Inspection  to  Compare 


Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 
visual  feed 

Selective  attention 

filter  out  rest  of 
possible  visual 
distractions 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
possible  visual 
distractions 

Selective  attention 

determining  time 
of  creation 

Quality  of  Feed, 
Visibility,  Salience, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations 

Detect 

use  cues  to 

determine  time  of 

creation 

Perceptual 

sensitivity 

search  for 

provided 

geolocation 

Expertise, 

Expectations 

Distributed 

attention 

search  shadow 

cues  to  determine 

time 

search  google 
earth 

Search 

search  for 

provided 

geolocation 

Sustained 

attention 

recognize  and 
label  provided 
geolocation 

Salience,  Visibility, 
Activity  Levels, 
Expertise,  Number 
of  Cues 
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search  shadow 

cues  to  determine 

time 

Perceptual 

sensitivity 

recognize  and 
label  shadow  cues 

search  google 
earth 

recognize  and 
label  google  earth 

cues 

Identify 

recognize  and 
label  provided 
geolocation 

Perceptual 

discrimination 

view  symbols  from 

provided 

geolocation 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

recognize  and 
label  shadow  cues 

Long-term 

memory 

view  shadow  cues 

recognize  and 
label  google  earth 

cues 

Working  memory 

view  google  earth 

cues 

Message 

view  symbols  from 

provided 

geolocation 

Response 

precision 

processing  of 

provided 

geolocation 

Expertise, 

Knowledge, 

Quality  of  Oral 
Communication, 
Quality  of  Chat 
Room 

view  shadow  cues 

processing  of 
shadow  cues 

view  google  earth 

cues 

processing  of 
google  earth  cues 

Queue  to  Channel 

processing  of 

provided 

geolocation 

Working  memory 

translating 

provided 

geolocation 

Time  Constraints, 

Computational 

aid,  Activity  Levels, 

Expertise, 

Knowledge, 

Vigilance, 

Situation 

Awareness, 

Expectations 

processing  of 
shadow  cues 

Processing 

strategy 

translating 
shadow  cues 
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processing  of 
google  earth  cues 

translating  google 
earth  cues 

Code 

translating 

provided 

geolocation 

Response 

precision 

saving  provided 
geolocation 

Computational 

Aid,  Expertise, 

Knowledge, 

Expectations 

translating 
shadow  cues 

Working  memory 

saving  shadow 

cues 

translating  google 
earth  cues 

Long-term 

memory 

saving  google 
earth  cues 

Store  in  Buffer 

saving  provided 
geolocation 

Working  memory 

compare  images 
based  on  selected 

cue 

Computational 

Aid,  Time 
Constraints 

saving  shadow 

cues 

Processing 

strategy 

saving  google 
earth  cues 

Decide/Select 

compare  images 
based  on  selected 

cue 

Long-term 

memory 

response  to  which 
cue  to  use  in  visual 
inspection 

Number  of 
Competing  Feeds, 
Amount  of 

Activity,  Expertise, 
Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 

Processing 

strategy 

Adapt/Learn 

response  to  which 
cue  to  use  in  visual 
inspection 

Long-term 

memory 

efficient  visual 
inspection  of  past 
data  to  complete 
mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

using  all  resources 
to  accurately 
determine 

creation  time  of 

data 

Goal  Image 

efficient  visual 

Long-term 

determine  time  of 

Quality  of  Feed, 
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inspection  of  past 
data  to  complete 
mission 

memory 

creation  for 

successful  mission 

Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

using  all  resources 
to  accurately 
determine 

creation  time  of 

data 

Processing 

strategy 

Mapping/Determine  Significance  Based  on  Time 


Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Identify 

recognize  and 
label  comparison 
of  data 

Perceptual 

discrimination 

keep  relevant 
information  saved 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

recognize  and 
label  time  of 

creation 

Long-term 

memory 

store  information 

on  time  of 

creation 

Working  memory 

Store  in  Buffer 

keep  relevant 
information  saved 

Working  memory 

figure  out  if 
comparison  is 
significant 

Computational 

Aid,  Time 
Constraints 

store  information 

on  time  of 

creation 

Processing 

strategy 

Compute 

figure  out  if 
comparison  is 
significant 

Processing 

strategy 

normal  or 

abnormal 

comparison 

Computational 

Aid,  Time 

Constraints, 

Expertise 

62 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


Working  memory 

Decide/Select 

normal  or 

abnormal 

comparison 

Long-term 

memory 

continue  to  match 

to  normal 
comparison 

Number  of 
Competing  Feeds, 
Amount  of 

Activity,  Expertise, 
Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 

Processing 

strategy 

continue  to  match 

to  abnormal 
comparison 

Plan 

match  to  normal 
comparison 

Working  memory 

test  current 
behavior  being 
observed  to 

normal 

Expectations, 

Expertise 

match  to 

abnormal 

comparison 

Processing 

strategy 

test  current 
behavior  being 
observed  to 

abnormal 

Test 

test  comparison  to 
knowledge  of 
normal 

Perceptual 

sensitivity 

no  significance  of 
comparison 

Knowledge, 

Expertise 

test  comparison  to 
knowledge  of 
abnormality 

Working  memory 

significance  of 
comparison 

Long-term 

memory 

Interpret 

no  significance  of 
comparison 

Long-term 

memory 

ignore  if  no 
significance 

Expertise, 

Knowledge, 

Number  of  Cues 

significance  of 
comparison 

Sustained 

attention 

contact  customer 

if  determined 
significant 

Categorize 

ignore  if  no 
significance 

Long-term 

memory 

continue  scanning 
for  POL  activity 

Expertise, 

Knowledge, 

Number  of  Cues 
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contact  customer 

if  determined 
significant 

Perceptual 

sensitivity 

communicate  with 

customer 

document  for  final 
product  report 

Adapt/Learn 

appropriate 
response  if 
determined  non¬ 
significant 

Long-term 

memory 

efficient  visual 
inspection  of 
significance  to 
complete  mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

appropriate 
response  if 
determined 
significant 

efficient  mapping 
to  complete 
mission 

Goal  Image 

efficient  visual 
inspection  of 
significance  to 
complete  mission 

Long-term 

memory 

continue  scanning 
for  POL  activity 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

efficient  mapping 
to  complete 
mission 

Processing 

strategy 

communicate  with 

customer 

document  for  final 
product  report 
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KML  Loaded  with  Markers/Look  at  Historical  Data 


Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  & 

Environmental 

Demands 

Input  Select 

visually  pay 
attention  to  KML 

data 

Selective  attention 

filter  out 

irrelevant  markers 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 
markers 

Perceptual 

sensitivity 

Filter 

filter  out 

irrelevant  markers 

Selective  attention 

determine  cues  to 
help  with  current 
mission 

Quality  of  Feed, 
Visibility,  Salience, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations 

Detect 

determine  cues  to 
help  with  current 
mission 

Perceptual 

sensitivity 

recognize  and 
label  relevant 

markers 

Expertise, 

Expectations 

Distributed 

attention 

Identify 

recognize  and 
label  relevant 

markers 

Perceptual 

discrimination 

save  relevant 

information  for 

future  use 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

Long-term 

memory 

Working  memory 

Store 

save  relevant 

information  for 

future  use 

Working  memory 

response  to  KML 
data 

Aid,  Time 
Constraints 

Long-term 
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memory 

Adapt/Learn 

response  to  KML 
data 

Long-term 

memory 

efficient  visual 
inspection  of  KML 
data  to  complete 
mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

efficient 

determination  of 
relevancy  of 
markers  to 
complete  mission 

Goal  Image 

efficient  visual 
inspection  of  KML 
data  to  complete 
mission 

Long-term 

memory 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

efficient 

determination  of 
relevancy  of 
markers  to 
complete  mission 

Processing 

strategy 

review  historical 

data 

Look  at  Historical  Data/Look  in  Local  Image  Base 


Cognitive  Agent 
Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  & 

Environmental 

Demands 

Input  Select 

visually  pay 
attention  to  KML 

data 

Selective  attention 

filter  out 

irrelevant  activity 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 
local  images 

Perceptual 

sensitivity 

Filter 

filter  out 
irrelevant  activity 

Selective  attention 

determine  cues  to 
help  with  current 

Quality  of  Feed, 
Visibility,  Salience, 
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mission 

Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations 

Detect 

determine  cues  to 
help  with  current 
mission 

Perceptual 

sensitivity 

recognize  and 
label  relevant 
activity 

Expertise, 

Expectations 

Distributed 

attention 

Identify 

recognize  and 
label  relevant 
activity 

Perceptual 

discrimination 

save  relevant 

information  for 

future  use 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

Long-term 

memory 

Working  memory 

Store 

save  relevant 

information  for 

future  use 

Working  memory 

response  to  local 
image  data 

Aid,  Time 
Constraints 

Long-term 

memory 

Adapt/Leam 

response  to  local 
image  data 

Long-term 

memory 

efficient  visual 
inspection  of  local 
image  data  to 
complete  mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

efficient 

determination  of 
relevancy  of  local 
image  data  activity 
to  complete 
mission 

Goal  Image 

efficient  visual 
inspection  of  local 
image  data  to 

Long-term 

memory 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
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complete  mission 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

efficient 

determination  of 
relevancy  of  local 
image  data  activity 
to  complete 
mission 

Processing 

strategy 

review  local 

historical  data 

Look  at  Historical  Data/ID  Permanent  Environmental  Structures 


Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change  in  Feed, 

permanent 

attention 

activity  in 

Visibility,  Activity  Levels, 

environmental 

structures  in  local 

historical  data 

watch  window 

Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

structure 

Salience,  Rate  of  Change,  Activity 

window 

requires 

Levels,  Competing  Watch 

attention 

Window  or  Feeds,  Number  of 

Cues,  Expertise,  Expectations 

Detect 

determining  if 

Perceptual 

search  for 

Expertise,  Expectations 

structure  requires 

sensitivity 

permanent 

attention 

environmental 

structures 

within  visual 

data 

Distributed 

attention 

Search 

search  for 

permanent 

environmental 

structures  within 

visual  data 

Sustained 

attention 

recognize  and 
label  structures 

Salience,  Visibility,  Activity 

Levels,  Expertise,  Number  of 

Cues 

Perceptual 
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sensitivity 

Identify  recognize  and  label  Perceptual  store  Expertise,  Number  of  Cues,  Rates 

structures  discrimination  information  on  of  Change  in  Feed,  Situation 

structures  Awareness 

Long-term 

memory 

Working 

memory 

Store  in  Buffer 

store  information 

on  structures 

Working 

memory 

track  number  of 

structures 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Count 

track  number  of 

structures 

Sustained 

attention 

expectations  of 
structures 

Number  of  Competing  Feeds, 
Amount  of  Activity 

Working 

memory 

Plan 

expectations  of 
structures 

Working 

memory 

define  structure 

Expectations,  Expertise 

Processing 

strategy 

Categorize 

define  religious 
structure 

Long-term 

memory 

appropriate 
and  optimal 
reaction  to 
permanent 
environmental 

structures 

Expertise,  Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
permanent 
environmental 

structures  in  local 
image  data  base 

Long-term 

memory 

efficient  visual 
inspection  of 
local  images  to 
complete 
mission 

Expertise,  Knowledge,  Number 
of  Cues,  Time  Constraints 

Goal  Image  efficient  visual  Long-term  further  Quality  of  Feed,  Salience, 

inspection  of  local  memory  inspection  Visibility,  Rate  of  Change, 

images  to  complete  needed  to  Activity  Levels,  Competing  Watch 

mission  determine  Window  or  Feeds,  Number  of 

significance  Cues,  Expertise,  Expectations, 

with  FMV  feed  Knowledge 

Processing 

strategy 

Look  at  Historical  Data/ID  Structures 

Cognitive  Input  Human  Output  Task  and  Environmental  Demands 

Agent  Task  Information 

Processing 
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Resources 


Input  Select 

pay  attention  to 
structures  in 

local  historical 

data 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change  in  Feed, 
Visibility,  Activity  Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if 
structure 
requires 
attention 

Quality  of  Feed,  Visibility,  Salience, 
Rate  of  Change,  Activity  Levels, 
Competing  Watch  Window  or 

Feeds,  Number  of  Cues,  Expertise, 
Expectations 

Detect 

determining  if 
structure 

requires 

attention 

Perceptual 

sensitivity 

search  for 

structures 

within  visual 

data 

Expertise,  Expectations 

Distributed 

attention 

Search  search  for  Sustained  recognize  and  Salience,  Visibility,  Activity  Levels, 


structures  attention  label  structures  Expertise,  Number  of  Cues 

within  visual 

data 


Perceptual 

sensitivity 

Identify  recognize  and  Perceptual  store  Expertise,  Number  of  Cues,  Rates  of 

label  structures  discrimination  information  on  Change  in  Feed,  Situation 

structures  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store 

information  on 

structures 

Working 

memory 

track  number  of 

structures 

Computational  Aid,  Time 

Constraints 

Processing 

strategy 

Count 

track  number  of 

structures 

Sustained 

attention 

expectations  of 
structures 

Number  of  Competing  Feeds, 

Amount  of  Activity 

Working 

memory 

Plan 

expectations  of 
structures 

Working 

memory 

define  structure 

Expectations,  Expertise 

Processing 

strategy 

Categorize 

define  religious 
structure 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  structures  in 

Expertise,  Knowledge,  Number  of 
Cues 
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local  images 

Perceptual 

sensitivity 


Adapt/Learn 

appropriate  and 
optimal  reaction 
to  structures  in 
local  image  data 
base 

Long-term 

memory 

efficient  visual 
inspection  of 
local  images  to 
complete 
mission 

Expertise,  Knowledge,  Number  of 
Cues,  Time  Constraints 

Goal  Image 

efficient  visual 
inspection  of 
local  images  to 
complete 
mission 

Long-term 

memory 

further 
inspection 
needed  to 

determine 
significance  with 
FMV  feed 

Quality  of  Feed,  Salience,  Visibility, 
Rate  of  Change,  Activity  Levels, 
Competing  Watch  Window  or 

Feeds,  Number  of  Cues,  Expertise, 
Expectations,  Knowledge 

Processing 

strategy 

Customer  Gives  AOI(s)/  Define  Starting  Point(s) 

Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

recognize  AOI 

Salience,  Rate  of  Change  in  Feed, 

AOI  given 

attention 

Visibility,  Activity  Levels, 

Expertise 

pay  attention  to 

Perceptual 

recognize  CIED 

new  CIED  activity 

sensitivity 

activity 

Identify 

recognize  AOI 

Perceptual 

keep  location  of 

Expertise,  Number  of  Cues,  Rates 

discrimination 

AOI  for  future 

of  Change  in  Feed,  Situation 

use 

Awareness 

recognize  CIED 

Long-term 

keep  CIED 

activity 

memory 

activity  for 
future  use 

Working 

memory 

Store 

keep  location  of 

Working 

compute 

Computational  Aid,  Time 

AOI  for  future  use 

memory 

starting  point 
for  scanning 
watch  windows 

based  on 

location  of  AOI 

Constraints 

keep  CIED  activity 

Long-term 

compute 

for  future  use 

memory 

starting  point 
for  scanning 
watch  windows 

based  on  CIED 
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activity 

Compute 

compute  starting 

Processing 

choose  starting 

Computational  Aid,  Time 

point  for  scanning 
watch  windows 

strategy 

point 

Constraints,  Expertise 

Working 

memory 

if  starting  scan 
for  new  CIED 
activity  get  rid 
of  old  CIED 
activity  details 

Purge  if  starting  scan  for  Selective  choose  starting  Expertise 

new  CIED  activity  attention  point 

get  rid  of  old  CIED 
activity  details 

Decide/Select 

choose  starting 
point 

Long-term 

memory 

to  efficiently 
inspect  CIED 
activity  to 
complete 
mission 

Number  of  Competing  Feeds, 
Amount  of  Activity,  Expertise, 
Visibility,  Quality  of  Feed,  Rate  of 
Change,  Expectations 

Processing 

strategy 

Goal  Image 

ability  to 

efficiently  inspect 
CIED  activity  to 
complete  mission 

Long-term 

memory 

define  starting 
points  to  inspect 
CIED  activity 

Quality  of  Feed,  Salience, 

Visibility,  Rate  of  Change,  Activity 
Levels,  Competing  Watch 

Window  or  Feeds,  Number  of 

Cues,  Expertise,  Expectations, 
Knowledge 

Processing 

strategy 


Define  Starting  Point(s)/  Slow  Scan 

Cognitive 

Example 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change  in 

potential  CIED 

attention 

activity  in  watch 

Feed,  Visibility,  Activity  Levels, 

activities 

window 

Expertise 

pay  attention  to 

Perceptual 

target 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determine  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

activity  requires 

Salience,  Visibility,  Rate  of 

window 

attention 

Change,  Activity  Levels, 

Competing  Watch  Window  or 
Feeds,  Number  of  Cues, 

Expertise,  Expectations 
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Detect  determine  if  Perceptual  slowly  search  for  Expertise,  Expectations 

activity  requires  sensitivity  onlyCIED 

attention  activities 

Distributed 

attention 

Search  slowly  search  for  Sustained  recognize  and  Salience,  Visibility,  Activity 

onlyCIED  attention  label  activities  Levels,  Expertise,  Number  of 

activities  Cues 

Perceptual 

sensitivity 

Identify  recognize  and  Perceptual  store  relevant  Expertise,  Number  of  Cues, 

label  activities  discrimination  information  on  Rates  of  Change  in  Feed, 

activity  Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store  relevant 

information  on 
activity 

Working 

memory 

figure  out  if 
activity  is  CIED 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Compute 

figure  out  if 
activity  is  CIED 

Processing 

strategy 

expectations  of  a 
CIED  activity 

Computational  Aid,  Time 
Constraints,  Expertise 

Working 

memory 

Count 

keep  track  of 
number  of 

individual's 

performing 

activity 

Sustained 

attention 

expectations  of  a 
CIED  activity 

Number  of  Competing  Feeds, 
Amount  of  Activity 

Working 

memory 

Plan 

expectations  of  a 
CIED  activity 

Working 

memory 

determine 
meaning  of 
activity  observed 

Expectations,  Expertise 

Processing 

strategy 

Interpret 

determine 
meaning  of 
activity  observed 

Long-term 

memory 

define  and  name 
activity  as  CIED 

Expertise,  Knowledge,  Number 
of  Cues 

Sustained 

attention 

Categorize  define  and  name  Long-term  inspect  CIED  Expertise,  Knowledge,  Number 

activity  as  CIED  memory  activity  of  Cues,  Quality  of  Feed, 

73 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


Expectations 

Perceptual 

communicate 

sensitivity 

with  customer 

Adapt/Learn 

responses  to 

Long-term 

confirming  CIED 

Expertise,  Knowledge,  Number 

certain  activity 

memory 

activity 

of  Cues,  Time  Constraints 

reason  to 

communicate 

Goal  Image 

inspect  CIED 

Long-term 

further  scanning 

Quality  of  Feed,  Salience, 

activity 

memory 

for  inspection  of 

Visibility,  Rate  of  Change, 

CIED  activity 

Activity  Levels,  Competing 

Watch  Window  or  Feeds, 

Number  of  Cues,  Expertise, 
Expectations,  Knowledge 

communicate 

Processing 

with  customer 

strategy 

Define  Starting  Point(s)/Scan  Around  Point 

Cognitive 

Example 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change  in 

potential  CIED 

attention 

activity  in  watch 

Feed,  Visibility,  Activity  Levels, 

activities 

window 

Expertise 

pay  attention  to 

Perceptual 

target 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determine  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

activity  requires 

Salience,  Visibility,  Rate  of 

window 

attention 

Change,  Activity  Levels, 

Competing  Watch  Window  or 
Feeds,  Number  of  Cues, 

Expertise,  Expectations 

Detect 

determine  if 

Perceptual 

slowly  search  for 

Expertise,  Expectations 

activity  requires 

sensitivity 

only  CIED 

attention 

activities 

Distributed 

attention 

Search 

slowly  search  for 

Sustained 

recognize  and 

Salience,  Visibility,  Activity 

only  CIED 

attention 

label  activities 

Levels,  Expertise,  Number  of 

activities 

Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  relevant 

Expertise,  Number  of  Cues, 

label  activities 

discrimination 

information  on 

Rates  of  Change  in  Feed, 

activity 

Situation  Awareness 
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Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store  relevant 

information  on 
activity 

Working 

memory 

figure  out  if 
activity  is  CIED 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Compute 

figure  out  if 
activity  is  CIED 

Processing 

strategy 

expectations  of  a 
CIED  activity 

Computational  Aid,  Time 
Constraints,  Expertise 

Working 

memory 

Count 

keep  track  of 

Sustained 

expectations  of  a 

Number  of  Competing  Feeds, 

number  of 

individual's 

performing 

activity 

attention 

CIED  activity 

Amount  of  Activity 

Working 

memory 


Plan 

expectations  of  a 

Working 

determine 

Expectations,  Expertise 

CIED  activity 

memory 

meaning  of 

activity  observed 

Processing 

strategy 


Interpret 

determine 

Long-term 

define  and  name 

Expertise,  Knowledge,  Number 

meaning  of 
activity  observed 

memory 

activity  as  CIED 

of  Cues 

Sustained 

attention 


Categorize 

define  and  name 

Long-term 

inspect  CIED 

Expertise,  Knowledge,  Number 

activity  as  CIED 

memory 

activity 

of  Cues,  Quality  of  Feed, 
Expectations 

Perceptual 

communicate 

sensitivity 

with  customer 

Adapt/Learn 

responses  to 

Long-term 

confirming  CIED 

Expertise,  Knowledge,  Number 

certain  activity 

memory 

activity 

of  Cues,  Time  Constraints 

reason  to 

communicate 

Goal  Image 

inspect  CIED 

Long-term 

further  scanning 

Quality  of  Feed,  Salience, 

activity 

memory 

for  inspection  of 

Visibility,  Rate  of  Change, 

CIED  activity 

Activity  Levels,  Competing 

Watch  Window  or  Feeds, 

Number  of  Cues,  Expertise, 
Expectations,  Knowledge 
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communicate 

with  customer 

Processing 

strategy 
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Scanning/Check  Terrain 

Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Cognitive  Bias 

Agent  Task 

Information 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change 

terrain  cues 

attention 

activity  in  watch 

in  Feed,  Visibility,  Activity 

window 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

cue  requires 

Salience,  Rate  of  Change, 

window 

attention 

Activity  Levels, 

Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations 

Detect 

determining  if 

Perceptual 

search  for  cues 

Expertise,  Expectations 

cue  requires 
attention 

sensitivity 

within  visual  data 

Distributed 

attention 

Search 

search  for  cues 

Sustained 

recognize  and 

Salience,  Visibility, 

within  visual  data 

attention 

label  cues 

Activity  Levels,  Expertise, 
Number  of  Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information 

Expertise,  Number  of 

label  cues 

discrimination 

on  cues 

Cues,  Rates  of  Change  in 
Feed,  Situation 

Awareness 

Long-term 

memory 
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Working 

memory 


Store  in 

store  information 

Working 

track  number  of 

Computational  Aid,  Time 

Buffer 

on  cues 

memory 

cues 

Constraints 

Processing 

strategy 


Count 

track  number  of 

Sustained 

expectations  of 

Number  of  Competing 

cues 

attention 

cues 

Feeds,  Amount  of  Activity 

Working 

memory 


Plan 

expectations  of 

Working 

define  cues 

Expectations,  Expertise 

cues 

memory 

Processing 

strategy 


Categorize 

define  cues 

Long-term 

appropriate  and 

Expertise,  Knowledge, 

memory 

optimal  reaction 
to  terrain  cues 

Number  of  Cues 

Perceptual 

sensitivity 


Adapt/Learn 

appropriate  and 
optimal  reaction 
to  terrain  cues 

Long-term 

memory 

efficient  visual 
inspection  of 
terrain  cues  to 
complete  mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

Goal  Image 

efficient  visual 
inspection  of 
terrain  cues  to 
complete  mission 

Long-term 

memory 

further 
inspection 
needed  to 

determine 
significance  with 
FMV  feed 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels, 

Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations, 
Knowledge 


Processing 

strategy 
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Scanning/Check  for  Ambush 

Cues 

Cognitive  Input  Human  Output  Task  and  Environmental 

Agent  Task  Information  Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 
ambush  cues 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change  in 
Feed,  Visibility,  Activity 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if  cue 
requires  attention 

Quality  of  Feed,  Visibility, 
Salience,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations 

Detect  determining  if  Perceptual  search  for  cues  Expertise,  Expectations 

cue  requires  sensitivity  within  visual  data 

attention 

Distributed 

attention 

Search  search  for  cues  Sustained  recognize  and  Salience,  Visibility,  Activity 

within  visual  attention  label  cues  Levels,  Expertise,  Number  of 

data  Cues 

Perceptual 

sensitivity 

Identify  recognize  and  Perceptual  store  information  Expertise,  Number  of  Cues, 

label  cues  discrimination  on  cues  Rates  of  Change  in  Feed, 

Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store 

information  on 

cues 

Working 

memory 

track  number  of 

cues 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Count 

track  number  of 

cues 

Sustained 

attention 

expectations  of 

cues 

Number  of  Competing 

Feeds,  Amount  of  Activity 

Working 

memory 

Plan 

expectations  of 

cues 

Working 

memory 

define  cues 

Expectations,  Expertise 

Processing 

strategy 
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Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  ambush  cues 

Expertise,  Knowledge, 

Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction 
to  ambush  cues 

Long-term 

memory 

efficient  visual 
inspection  of 
ambush  cues  to 
complete  mission 

Expertise,  Knowledge, 

Number  of  Cues,  Time 
Constraints 

Goal  Image  efficient  visual  Long-term  further  inspection  Quality  of  Feed,  Salience, 

inspection  of  memory  needed  to  Visibility,  Rate  of  Change, 

ambush  cues  to  determine  Activity  Levels,  Competing 

complete  significance  with  Watch  Window  or  Feeds, 

mission  FMVfeed  Number  of  Cues,  Expertise, 

Expectations,  Knowledge 

Processing 

strategy 
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Scanning/Check  Traffic  Pattern 


Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change  in 

traffic  pattern 

attention 

activity  in  watch 

Feed,  Visibility,  Activity  Levels, 

cues 

window 

Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

cue  requires 

Salience,  Rate  of  Change, 

window 

attention 

Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations 

Detect 

determining  if 

Perceptual 

search  for  cues 

Expertise,  Expectations 

cue  requires 
attention 

sensitivity 

within  visual  data 

Distributed 

attention 

Search 

search  for  cues 

Sustained 

recognize  and 

Salience,  Visibility,  Activity 

within  visual  data 

attention 

label  cues 

Levels,  Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information 

Expertise,  Number  of  Cues, 

label  cues 

discrimination 

on  cues 

Rates  of  Change  in  Feed, 

Situation  Awareness 


Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store  information 

on  cues 

Working 

memory 

track  number  of 

cues 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Count 

track  number  of 

cues 

Sustained 

attention 

expectations  of 

cues 

Number  of  Competing  Feeds, 
Amount  of  Activity 

Working 

memory 

Plan 

expectations  of 

cues 

Working 

memory 

define  cues 

Expectations,  Expertise 

Processing 

strategy 

Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  traffic  pattern 

Expertise,  Knowledge,  Number 
of  Cues 
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cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction 
to  traffic  pattern 

cues 

Long-term 

memory 

efficient  visual 
inspection  of 
traffic  pattern 
cues  to  complete 
mission 

Expertise,  Knowledge,  Number 
of  Cues,  Time  Constraints 

Goal  Image 

efficient  visual 
inspection  of 
traffic  pattern 
cues  to  complete 
mission 

Long-term 

memory 

further  inspection 
needed  to 

determine 
significance  with 
FMV  feed 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations,  Knowledge 

Processing 

strategy 

Scanning/Check  Human  Activity 

Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change 

human  activity 

attention 

activity  in  watch 

in  Feed,  Visibility,  Activity 

cues 

window 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if  cue 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

requires  attention 

Salience,  Rate  of  Change, 

window 

Activity  Levels, 

Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations 

Detect 

determining  if  cue 

Perceptual 

search  for  cues 

Expertise,  Expectations 

requires  attention 

sensitivity 

within  visual  data 

Distributed 

attention 

Search 

search  for  cues 

Sustained 

recognize  and 

Salience,  Visibility, 

within  visual  data 

attention 

label  cues 

Activity  Levels,  Expertise, 
Number  of  Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information 

Expertise,  Number  of 

label  cues 

discrimination 

on  cues 

Cues,  Rates  of  Change  in 
Feed,  Situation 
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Awareness 


Long-term 

memory 

Working 

memory 


Store  in  Buffer 

store  information 

Working 

track  number  of 

Computational  Aid,  Time 

on  cues 

memory 

cues 

Constraints 

Processing 

strategy 


Count 

track  number  of 

Sustained 

expectations  of 

Number  of  Competing 

cues 

attention 

cues 

Feeds,  Amount  of  Activity 

Working 

memory 


Plan 

expectations  of 

Working 

define  cues 

Expectations,  Expertise 

cues 

memory 

Processing 

strategy 


Categorize 

define  cues 

Long-term 

appropriate  and 

Expertise,  Knowledge, 

memory 

optimal  reaction 
to  human  activity 

Number  of  Cues 

cues 

Perceptual 

sensitivity 


Adapt/Learn 

appropriate  and 
optimal  reaction 
to  human  activity 

cues 

Long-term 

memory 

efficient  visual 
inspection  of 
human  activity 
cues  to  complete 
mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

Goal  Image 

efficient  visual 
inspection  of 
human  activity 
cues  to  complete 
mission 

Long-term 

memory 

further  inspection 
needed  to 

determine 
significance  with 
FMV  feed 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels, 

Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations, 
Knowledge 

Processing 

strategy 
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Scanning/Check  Entrances 


Cognitive  Input  Human  Output  Task  and 

Agent  Task  Information  Environmental 

Processing  Demands 

Resources 

Input  Select 

pay  attention  to 
entrance  to 
buildings  activity 

cues 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if  cue 
requires  attention 

Quality  of  Feed, 
Visibility,  Salience, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations 

Detect  determining  if  cue  Perceptual  search  for  cues  Expertise, 

requires  attention  sensitivity  within  visual  data  Expectations 

Distributed 

attention 

Search  search  for  cues  Sustained  recognize  and  label  Salience,  Visibility, 

within  visual  data  attention  cues  Activity  Levels, 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify  recognize  and  label  Perceptual  store  information  Expertise,  Number  of 

cues  discrimination  on  cues  Cues,  Rates  of 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store  information 

on  cues 

Working 

memory 

track  number  of 

cues 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Count 

track  number  of 

cues 

Sustained 

attention 

expectations  of  cues 

Number  of 

Competing  Feeds, 
Amount  of  Activity 

Working 

memory 
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Plan 

expectations  of  cues 

Working 

memory 

define  cues 

Expectations, 

Expertise 

Processing 

strategy 

Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction  to 
entrance  to 
buildings  activity 

cues 

Expertise, 

Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
entrance  to 
buildings  activity 

cues 

Long-term 

memory 

efficient  visual 
inspection  of 
entrance  to 
buildings  activity 
cues  to  complete 
mission 

Expertise, 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

Goal  Image  efficient  visual  Long-term  further  inspection  Quality  of  Feed, 

inspection  of  memory  needed  to  Salience,  Visibility, 

entrance  to  determine  Rate  of  Change, 

buildings  activity  significance  with  Activity  Levels, 

cues  to  complete  FMV  feed  Competing  Watch 

mission  Window  or  Feeds, 

Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 

Scanning/Determine  Significance 


Cognitive  Agent 

Input 

Human 

Output 

Task  and 

Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Identify 

recognize  and 

Perceptual 

keep  relevant 

Expertise,  Number  of 

label  CIED  activity 

discrimination 

actions  saved 

Cues,  Rates  of  Change 

under  inspection 

in  Feed,  Situation 

in  FMV 

Awareness 

Long-term 

memory 

Working 

memory 

Store  in  Buffer 

keep  relevant 

Working 

figure  out  if 

Computational  Aid, 

actions  saved 

memory 

activity  is 
significant 

Time  Constraints 
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Processing 

figure  out  if 

strategy 

activity  is  non¬ 
significant 

Compute 

figure  out  if 

Processing 

track  people 

Computational  Aid, 

activity  is 

strategy 

performing 

Time  Constraints, 

significant 

activity 

Expertise 

figure  out  if 

Working 

activity  is  non¬ 
significant 

memory 

Count 

track  people 

Sustained 

people 

Number  of  Competing 

under  inspection 

attention 

performing 

Feeds,  Amount  of 

normal  or 
abnormal  activity 

Activity 

Working 

memory 

Decide/Select 

normal  or 

Long-term 

continue  to  match 

Number  of  Competing 

abnormal  actions 

memory 

to  normal 

Feeds,  Amount  of 

observed 

Activity,  Expertise, 

behavior 

Visibility,  Quality  of 
Feed,  Rate  of  Change, 
Expectations 

Processing 

continue  to  match 

strategy 

to  abnormal 

observed 

behavior 

Plan 

match  to  normal 

Working 

test  current 

Expectations, 

observed 

memory 

behavior  being 

Expertise 

activities 

observed  to 

normal 

match  to 

Processing 

test  current 

abnormal 

strategy 

behavior  being 

observed 

observed  to 

activities 

abnormal 

Test 

test  activity  being 

Perceptual 

potential  need  for 

Knowledge,  Expertise 

performed  to 

sensitivity 

further 

knowledge  of  a 

investigation 

normal  activity 


test  activity  being 
performed  to 
knowledge  of  an 
abnormal  activity 

Working 

memory 

Long-term 

memory 

Interpret 

potential  need  for 
further 
investigation 
based  on 

Long-term 

memory 

reason  for  action 

Expertise,  Knowledge, 
Number  of  Cues 
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interpretation 

Sustained 

attention 


Categorize 

reason  for  action 

Long-term 

memory 

efficient  visual 
inspection  of 
actions  to 
complete  mission 

Expertise,  Knowledge, 
Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction 
to  actions 
performed 

Long-term 

memory 

efficient 
significance  of 
activity 
determined  to 
complete  mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

Goal  Image 

efficient 
significance  of 
activity 

determined  to 
complete  mission 

Long-term 

memory 

determined 

significant 

Quality  of  Feed, 
Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 

Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing 

determined  non- 

strategy 

significant 

document  for  final 
product  report 


Tracking/  Tracking  Request  Made 


Cognitive  Agent  Task  Input  Human  Output  Task  and  Environmental 


Information  Demands 

Processing 
Resources 


Input  Select 

pay 

attention  to 

customer's 
request  to 
track  target 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change 
in  Feed,  Visibility,  Activity 
Levels,  Expertise 

visually  pay 
attention  to 
target  for 
tracking 

Perceptual 

sensitivity 

Filter 

filter  out 

rest  of 
activity  in 

Selective 

attention 

recognize  and 
label  target 

Quality  of  Feed,  Visibility, 
Salience,  Visibility,  Rate  of 
Change,  Activity  Levels, 

87 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


watch 

window 

Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations 

Detect  customer  Perceptual  recognize  and  Expertise,  Expectations 

requires  sensitivity  label  target 

tracking  of 
target 

Distributed 

attention 

Identify  recognize  Perceptual  requires  the  Expertise,  Number  of 

and  label  discrimination  visual  inspection  Cues,  Rates  of  Change  in 

target  process  to  track  Feed,  Situation  Awareness 

target 

Long-term 

memory 

Working 

memory 

Queue  to  Channel 

requires 
the  visual 
inspection 
process  to 
track  target 

Working 

memory 

store 

information  on 
target  to  carry 
out  tracking 
request 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

Processing 

strategy 

Store  in  Buffer 

store 

information 
on  target  to 
carry  out 
tracking 
request 

Working 

memory 

figuring  out  if 
WAMI  is 

sufficient  for 
tracking 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Compute 

figuring  out 
if  WAMI  is 

sufficient 
for  tracking 

Processing 

strategy 

follow  process 
for  following  out 
a  tracking 
request 

Computational  Aid,  Time 
Constraints,  Expertise 

Working 

memory 

Purge 

follow 
process  for 
following 
out  a 
tracking 
request 

Selective 

attention 

reset  to  track 
target 

Expertise 

Reset  reset  to  Selective  reacting  to  Expertise 

track  target  attention  customer's 
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tracking  request 

Response 

precision 

Control 

reacting  to 

Response 

start  visual 

Expertise,  Knowledge, 

customer's 

precision 

inspection 

Number  of  Cues,  Time 

tracking 

process  to  track 

Constraints 

request 

target 

Decide/Select 

start  visual 

Long-term 

plan  for  tracking 

Number  of  Competing 

inspection 

memory 

target 

Feeds,  Amount  of  Activity, 

process  to 

Expertise,  Visibility, 

track  target 

Quality  of  Feed,  Rate  of 
Change,  Expectations 

Processing 

strategy 

Plan 

plan  for 

Working 

processing 

Expectations,  Expertise 

tracking 

memory 

tracking  requests 

target 

for  targets 

Processing 

strategy 

Adapt/Learn 

processing 

Long-term 

follow  out 

Expertise,  Knowledge, 

tracking 

memory 

tracking  request 

Number  of  Cues,  Time 

requests 

to  complete 

Constraints 

for  targets 

mission 

Goal  Image 

follow  out 

Long-term 

switch  to  FMV 

Quality  of  Feed,  Salience, 

tracking 

memory 

feed 

Visibility,  Rate  of  Change, 

request  to 

Activity  Levels,  Competing 

complete 

Watch  Window  or  Feeds, 

mission 

Number  of  Cues, 

Expertise,  Expectations, 
Knowledge 

Processing 

place  pin  for 

strategy 

tracking 

Tracking/  Switch  to 
FMV 


Cognitive  Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and  Environmental 

Demands 

Input  Select 

switch  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change 

FMV  feed 

attention 

activity  in  watch 

in  Feed,  Visibility, 

window 

Activity  Levels,  Expertise 

pay 

Perceptual 

attention  to 

sensitivity 

target 

Filter 

filter  out  rest 

Selective 

search  for  target 

Quality  of  Feed, 
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of  activity  in 

attention 

Visibility,  Salience, 

watch 

Visibility,  Rate  of 

window 

Change,  Activity  Levels, 
Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations 

Search 

search  for 

Sustained 

recognize  and 

Salience,  Visibility, 

target 

attention 

label  target 

Activity  Levels, 

Expertise,  Number  of 

Cues 

Perceptual 

recognize  and 

sensitivity 

label  movement 
of  target 

Identify 

recognize 

Perceptual 

message  to  have 

Expertise,  Number  of 

and  label 

discrimination 

spotball  moved 

Cues,  Rates  of  Change  in 

target 

due  to 

Feed,  Situation 

movement  of 
target 

Awareness 

recognize 

Long-term 

and  label 

memory 

movement 

of  target 

Working 

memory 

Message 

message  to 

Response 

use  military 

Expertise,  Knowledge, 

have 

precision 

jargon  in 

Quality  of  Oral 

spotball 

message 

Communication,  Quality 

moved  due 

of  Chat  Room 

to 

movement 

of  target 

Code 

use  military 

Response 

verbal  or  written 

Expertise,  Knowledge 

jargon  in  precision  message  on 

message  movement  of 


target 


Working 

memory 

Long-term 

memory 

Transmit 

message  is 
written  or 

verbal 

Response 

precision 

verbal  or  written 

message  on 

movement  of 
target 

Expertise,  Knowledge, 
Quality  of  Oral 
Communication,  Quality 
of  Chat  Room 

Reset 

FMV  feed 
changes  due 
to  spotball 

Selective 

attention 

track  target 

Expertise 
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repositionin 

g 

Response 

precision 

Count 

keep  track  of 
targets  if 
more  than 

one 

Sustained 

attention 

search  and 
identify  target 

Number  of  Competing 
Feeds,  Amount  of 

Activity 

Working 

memory 

Decide/Select 

track  target 

Long-term 

memory 

track  target  using 
new  spotball 
position 

Number  of  Competing 
Feeds,  Amount  of 

Activity,  Expertise, 
Visibility,  Quality  of 

Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

Plan 

track  target 
using  new 
spotball 
position 

Working 

memory 

test  if  target  can 
be  tracked  with 
new  spotball 
position 

Expectations,  Expertise 

Processing 

strategy 

Test 

test  if  target 
can  be 

tracked  with 
new  spotball 
position 

Perceptual 

sensitivity 

spotball  in 
correct  position 

Knowledge,  Expertise 

Working 

memory 

spotball  in 
incorrect  position 

Long-term 

memory 

Interpret 

spotball  in 

correct 

position 

Long-term 

memory 

start  tracking 
target 

Expertise,  Knowledge, 
Number  of  Cues 

spotball  in 

incorrect 

position 

Sustained 

attention 

new  message  to 
get  correct 
positioning  of 
spotball 

Adapt/Learn 

responding 
to  target 

movement 

Long-term 

memory 

efficient 
repositioning  of 
spotball  to 
complete  mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

responding 
to  need  for 

efficient  tracking 
of  target  using 
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new  spotball 
position 

FMV  to  complete 
mission 

Goal  Image  efficient  Long-term  track  target  for  Quality  of  Feed, 

repositionin  memory  successful  Salience,  Visibility,  Rate 

gofspotball  mission  of  Change,  Activity 

to  complete  Levels,  Competing 

mission  Watch  Window  or 

Feeds,  Number  of  Cues, 
Expertise,  Expectations, 
Knowledge 

efficient 
tracking  of 
target  using 
FMVto 
complete 
mission 

Processing 

strategy 

Tracking/  Track  Target 

Cognitive  Agent  Task  Input  Human  Output  Task  and  Environmental 

Information  Demands 

Processing 

Resources 

Input  Select 

pay 

attention 
to  target 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change  in 
Feed,  Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out 

rest  of 
activity  in 
watch 

window 

Selective 

attention 

search  for  target 

Quality  of  Feed,  Visibility, 
Salience,  Visibility,  Rate  of 
Change,  Activity  Levels, 
Competing  Watch  Window 
or  Feeds,  Number  of  Cues, 
Expertise,  Expectations 

Search  search  for  Sustained  recognize  and  Salience,  Visibility,  Activity 

target  attention  label  target  Levels,  Expertise,  Number 

of  Cues 

Perceptual 

sensitivity 

recognize  and 
label  movement 
of  target 

Identify  recognize  Perceptual  keep  track  of  Expertise,  Number  of  Cues, 

and  label  discriminatio  targets  if  more  Rates  of  Change  in  Feed, 

target  n  than  one  Situation  Awareness 

recognize 
and  label 

movement 
of  target 

Long-term 

memory 

track  target 

Working 
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memory 


Count 

keep  track 

Sustained 

track  target 

Number  of  Competing 

of  targets 

attention 

Feeds,  Amount  of  Activity 

if  more 

than  one 

Working 

memory 


Decide/Select 

track 

Long-term 

plan  for  tracking 

Number  of  Competing 

target 

memory 

target 

Feeds,  Amount  of  Activity, 
Expertise,  Visibility,  Quality 
of  Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 


Plan 

plan  for 

Working 

efficient  tracking 

Expectations,  Expertise 

tracking 

memory 

of  target  at 

target 

starting  position 

to  complete 

mission 

Processing 

strategy 


Goal  Image 

efficient 

Long-term 

track  target  for 

Quality  of  Feed,  Salience, 

tracking  of 

memory 

successful 

Visibility,  Rate  of  Change, 

target  at 

mission 

Activity  Levels,  Competing 

starting 

Watch  Window  or  Feeds, 

position  to 

Number  of  Cues,  Expertise, 

complete 

Expectations,  Knowledge 

mission 

Processing 

strategy 
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Tracking/  Define 

Starting  Point(s) 

Cognitive  Agent  Task 

Input 

Human 

Output 

Task  and  Environmental 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay 

Selective 

filter  out  rest 

Salience,  Rate  of  Change  in 

attention  to 

attention 

of  activity  in 

Feed,  Visibility,  Activity 

target  for 

watch 

Levels,  Expertise 

tracking 

window 

Perceptual 

sensitivity 

Filter 

filter  out 

Selective 

recognize 

Quality  of  Feed,  Visibility, 

rest  of 

attention 

target 

Salience,  Visibility,  Rate  of 

activity  in 

Change,  Activity  Levels, 

watch 

Competing  Watch  Window  or 

window 

Feeds,  Number  of  Cues, 
Expertise,  Expectations 

Identify 

recognize 

Perceptual 

keep 

Expertise,  Number  of  Cues, 

target 

discriminatio 

identification 

Rates  of  Change  in  Feed, 

n 

of  target  for 
future  use 

Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store 

keep 

Working 

compute 

Computational  Aid,  Time 

identificatio 

memory 

starting  point 

Constraints 

n  of  target 

for  scanning 

for  future 

watch 

use 

windows 

based  on 

location  of 

AOI 

Long-term 

compute 

memory 

starting  point 
for  scanning 
watch 

windows 

based  on 
target 

compute 
starting  point 
for  scanning 
watch 

windows 

based  on  POL 
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activity 

Compute 

compute 

Processing 

choose 

Computational  Aid,  Time 

starting 
point  for 
scanning 
watch 

windows 

strategy 

starting  point 

Constraints,  Expertise 

Working 

memory 

Purge 

get  rid  of  old 

Selective 

choose 

Expertise 

information 

attention 

starting  point 

get  rid  of 

give  other 

other  watch 

AOIs  to  other 

windows 

analyst 

Reset 

give  other 

Selective 

choose 

Expertise 

AOIs  to 

attention 

starting  point 

other 

to  start 

analyst 

scanning  for 
target 

Response 

precision 

Decide/Select 

choose 

Long-term 

to  efficiently 

Number  of  Competing  Feeds, 

starting 

memory 

track  a  target 

Amount  of  Activity, 

point 

to  complete 

Expertise,  Visibility,  Quality 

mission 

of  Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

Goal  Image 

ability  to 

Long-term 

define 

Quality  of  Feed,  Salience, 

efficiently 

memory 

starting 

Visibility,  Rate  of  Change, 

track  a 

points  to 

Activity  Levels,  Competing 

target  to 

track  a  target 

Watch  Window  or  Feeds, 

complete 

for  a 

Number  of  Cues,  Expertise, 

mission 

successful 

Expectations,  Knowledge 

mission 

Processing 

strategy 

B.2  CIED:  Rural  Scan  OFM-COG  Table 
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rooms 

correspondent(s) 

Levels,  Expertise 

pay  attention  to 

Perceptual 

ignore 

verbal 

sensitivity 

unnecessary 

communication 
through 
TeamSpeak  or 
locally 

visual  data 

Filter 

ignore  messages 

Selective 

determine  which 

Expertise,  Activity  Levels, 

to  other 

attention 

messages  require 

Quality  of  Communication 

correspondent(s) 

attention  or 

action 

Feed 

Detect 

determine  which 

Perceptual 

recognize 

Expertise,  Expectations, 

messages  require 

sensitivity 

important  or 

Salience,  Rate  of  Change  in 

attention  or 

relevant 

Feed 

action 

messages  and 
label  them 

Distributed 

attention 

Identify 

recognize 

Perceptual 

written  or  verbal 

Expertise,  Number  of  Cues, 

important  or 

discrimination 

communication 

Rates  of  Change  in  Feed, 

relevant 

(through  chat 

Situation  Awareness,  Time 

messages  and 

room  or 

Constraints 

label  them 

TeamSpeak) 

Long-term 

memory 

Working 

memory 

Message 

written  or  verbal 

Response 

determine  form 

Expertise,  Knowledge, 

communication 

precision 

of 

Quality  of  Oral 

(through  chat 

communication 

Communication,  Quality  of 

room  or 

needed  (written 

Chat  Room 

TeamSpeak) 

or  verbal) 

Code 

determine  form 

Response 

communicating  in 

Aid,  Expertise,  Knowledge, 

of 

precision 

correct  format  to 

Expectations 

communication 

appropriate 

needed  (written 
or  verbal) 

person 

Working 

memory 

Long-term 

memory 

Transmit 

communicating  in 

Response 

understanding 

Quality  of  Communication 

correct  format  to 

precision 

messages 

Feed,  Physical  Action,  Time 

appropriate 

Constraints,  Display 

person 

Representation, 

Competing  Transmissions, 
Expertise,  Knowledge 
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Compute 

understanding 

Processing 

use  military 

Computational  Aid,  Quality 

messages 

strategy 

jargon 

of  Communication  Feed, 
Time  Constraints, 

Competing  Chat  Rooms, 
Competing  Transmissions, 
Expertise,  Knowledge, 
Vigilance 

Working 

memory 

Edit 

use  military 

Long-term 

accurate 

Expertise,  Knowledge, 

jargon 

memory 

communication 

and  method 

Expectations 

Selective 

attention 

Display 

accurate 

Response 

response  needed 

Expertise,  Knowledge, 

communication 

precision 

or  not 

Quality  of  Communication 

and  method 

Feed,  Competing 
Transmissions 

respond  to  whom 

Decide/Select 

response  needed 

Long-term 

communication 

Expertise,  Knowledge, 

or  not 

memory 

meets 

Situation  Awareness, 

expectations  of 
sensor  operator 

Expectations 

respond  to  whom 

Processing 

strategy 

Plan 

communication 

Working 

determining 

Expertise,  Knowledge, 

meets 

memory 

accurate 

Expectations 

expectations  of 
sensor  operator 

communications 

Processing 

strategy 

Test 

determining 

Perceptual 

interpret 

Expertise,  Knowledge, 

accurate 

sensitivity 

communication 

Expectations 

communications 

and  sensor 
operator's  needs 

Working 

memory 

Long-term 

memory 

Interpret 

interpret 

Long-term 

appropriate  and 

Quality  of  Communication 

communication 

memory 

optimal 

Feed,  Expertise, 

and  sensor 

responses  to 

Knowledge,  Expectations 

operator's  needs 

communication 

with  sensor 
operator 

Sustained 

attention 
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Adapt/Learn 

appropriate  and 

Long-term 

efficient 

Expertise,  Knowledge, 

optimal 

memory 

communication 

Time  Constraints, 

responses  to 

with  sensor 

Competing  Transmissions, 

communication 

operator  to 

Activity  Levels 

with  sensor 

complete  mission 

operator 

Goal  Image  efficient  Long-term  Quality  of  Communication, 


communication  memory  Activity  Levels,  Competing 

with  sensor  Transmissions,  Expertise, 

operator  to  Expectations,  Knowledge 

complete  mission 


Processing 

strategy 

Communication/  Aircraft  Operator 

Cognitive  Agent 

Input 

Human 

Output 

Task  and  Environmental 

Task 

Information 

Demand 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

ignore  messages 

Salience,  Rate  of  Change  in 

verbal 

attention 

to  other 

Feed,  Visibility,  Activity 

communication 

through 

TeamSpeak 

correspondent(s) 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

ignore  messages 

Selective 

determine  which 

Expertise,  Activity  Levels, 

to  other 

attention 

messages  require 

Quality  of  Communication 

correspondent(s) 

attention  or 

action 

Feed 

Detect 

determine  which 

Perceptual 

recognize 

Expertise,  Expectations, 

messages  require 

sensitivity 

important  or 

Salience,  Rate  of  Change  in 

attention  or 

relevant 

Feed 

action 

messages  and 
label  them 

Distributed 

attention 

Identify 

recognize 

Perceptual 

message  is  verbal 

Expertise,  Number  of  Cues, 

important  or 

discrimination 

Rates  of  Change  in  Feed, 

relevant 

Situation  Awareness,  Time 

messages  and 
label  them 

Constraints 

Long-term 

memory 

Working 

memory 

Message 

message  is  verbal 

Response 

understanding 

Expertise,  Knowledge, 
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precision 

messages 

Quality  of  Oral 
Communication,  Quality  of 
Chat  Room 

Compute 

understanding 

Processing 

use  military 

Computational  Aid,  Quality 

messages 

strategy 

jargon 

of  Communication  Feed, 
Time  Constraints, 

Competing  Chat  Rooms, 
Competing  Transmissions, 
Expertise,  Knowledge, 
Vigilance 

Working 

memory 

Edit 

verbal 

Long-term 

accurate 

Expertise,  Knowledge, 

communication 

memory 

communication 

Expectations 

in  military  jargon 

and  method 

Selective 

attention 

Display 

accurate 

Response 

response  needed 

Expertise,  Knowledge, 

communication 

precision 

or  not 

Quality  of  Communication 

and  method 

Feed,  Competing 
Transmissions 

respond  to  whom 

Decide/Select 

response  needed 

Long-term 

communication 

Expertise,  Knowledge, 

or  not 

memory 

meets 

Situation  Awareness, 

expectations  of 
aircraft  operator 

Expectations 

respond  to  whom 

Processing 

strategy 

Plan 

communication 

Working 

determining 

Expertise,  Knowledge, 

meets 

memory 

accurate 

Expectations 

expectations  of 
aircraft  operator 

communications 

Processing 

strategy 

Test 

determining 

Perceptual 

interpret 

Expertise,  Knowledge, 

accurate 

sensitivity 

communication 

Expectations 

communications 

and  aircraft 
operator's  needs 

Working 

memory 

Long-term 

memory 


Interpret 

interpret 

Long-term 

appropriate  and 

Quality  of  Communication 

communication 

memory 

optimal 

Feed,  Expertise, 

and  aircraft 

responses  to 

Knowledge,  Expectations 

operator's  needs 

communication 

with  aircraft 
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operator 

Sustained 

attention 

Adapt/Learn 

appropriate  and 

Long-term 

efficient 

Expertise,  Knowledge, 

optimal 

memory 

communication 

Time  Constraints, 

responses  to 

with  aircraft 

Competing  Transmissions, 

communication 

operator  to 

Activity  Levels 

with  aircraft 
operator 

complete  mission 

Goal  Image 

efficient 

Long-term 

Quality  of  Communication, 

communication 

memory 

Activity  Levels,  Competing 

with  aircraft 

Transmissions,  Expertise, 

operator  to 
complete  mission 

Expectations,  Knowledge 

Processing 

strategy 

Communication/  Other  Analyst 

Cognitive  Agent 

Input 

Human 

Output 

Task  and  Environmental 

Task 

Information 

Demand 

Processing 

Resources 

Input  Select 

visually  pay 

Selective 

ignore  messages 

Salience,  Rate  of  Change  in 

attention  to  chat 

attention 

to  other 

Feed,  Visibility,  Activity 

rooms 

analyst(s) 

Levels,  Expertise 

pay  attention  to 

Perceptual 

verbal 

communication 
through 
TeamSpeak  or 
locally 

sensitivity 

Filter 

ignore  messages 

Selective 

determine  which 

Expertise,  Activity  Levels, 

to  other 

attention 

messages  require 

Quality  of  Communication 

analyst(s) 

attention  or 

action 

Feed 

Detect 

determine  which 

Perceptual 

label  relevant 

Expertise,  Expectations, 

messages  require 

sensitivity 

messages 

Salience,  Rate  of  Change  in 

attention  or 

action 

Feed 

Distributed 

attention 

Identify 

label  relevant 

Perceptual 

written  or  verbal 

Expertise,  Number  of  Cues, 

messages 

discrimination 

communication 

Rates  of  Change  in  Feed, 

(through  chat 

Situation  Awareness,  Time 

room  or 

Constraints 

TeamSpeak) 
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Long-term 

memory 

Working 

memory 


Message 

written  or  verbal 

communication 
(through  chat 

room  or 

TeamSpeak) 

Response 

precision 

determine  form 

of 

communication 
needed  (written 
or  verbal) 

Expertise,  Knowledge, 
Quality  of  Oral 
Communication,  Quality  of 
Chat  Room 

Code 

determine  form 

of 

communication 
needed  (written 

Response 

precision 

communicating  in 
correct  format  to 
appropriate 
person 

Aid,  Expertise,  Knowledge, 
Expectations 

or  verbal) 


Working 

memory 

Long-term 

memory 


Transmit 

communicating  in 
correct  format  to 
appropriate 
person 

Response 

precision 

understanding 

incoming 

message 

Quality  of  Communication 
Feed,  Physical  Action,  Time 
Constraints,  Display 
Representation, 

Competing  Transmissions, 
Expertise,  Knowledge 

Compute 

understanding 

incoming 

message 

Processing 

strategy 

use  military 
jargon 

Computational  Aid,  Quality 
of  Communication  Feed, 
Time  Constraints, 

Competing  Chat  Rooms, 
Competing  Transmissions, 
Expertise,  Knowledge, 
Vigilance 


Working 

memory 

Edit  written  or  verbal  Long-term  accurate  Expertise,  Knowledge, 


communication  memory  communication  Expectations 

(through  chat  and  method 

room  or 

TeamSpeak)  in 

military  jargon 


Selective 

attention 

Display 

accurate 

communication 

and  method 

Response 

precision 

response  needed 
or  not 

Expertise,  Knowledge, 
Quality  of  Communication 
Feed,  Competing 
Transmissions 

respond  to  whom 

Decide/Select 

response  needed 

Long-term 

communication 

Expertise,  Knowledge, 
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or  not 

memory 

meets 

Situation  Awareness, 

expectations  of 
sensor  operator 

Expectations 

respond  to  whom 

Processing 

strategy 

Plan 

communication 

Working 

determining 

Expertise,  Knowledge, 

meets 

memory 

accurate 

Expectations 

expectations  of 
sensor  operator 

communications 

Processing 

strategy 

Test 

determining 

Perceptual 

interpret 

Expertise,  Knowledge, 

accurate 

sensitivity 

communication 

Expectations 

communications 

and  analyst(s)'s 
needs 

Working 

memory 

Long-term 

memory 


Interpret 

interpret 

Long-term 

appropriate  and 

Quality  of  Communication 

communication 
and  analyst(s)'s 
needs 

memory 

optimal 
responses  to 

communication 

with  other 
analyst(s) 

Feed,  Expertise, 

Knowledge,  Expectations 

Sustained 

attention 


Adapt/Learn 

appropriate  and 
optimal 
responses  to 
communication 

with  other 
analyst(s) 

Long-term 

memory 

efficient 

communication 

with  other 
analyst(s)  to 
complete  mission 

Expertise,  Knowledge, 

Time  Constraints, 

Competing  Transmissions, 
Activity  Levels 

Goal  Image 

efficient 

communication 

with  other 
analyst(s)  to 

Long-term 

memory 

Quality  of  Communication, 
Activity  Levels,  Competing 
Transmissions,  Expertise, 
Expectations,  Knowledge 

complete  mission 


Processing 

strategy 
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Communication/  Customer  Redirects 


Cognitive  Agent  Input  Human  Output  Task  and  Environmental 

Task  Information  Demand 

Processing 

Resources 

Input  Select 

pay  attention  to 
new  information 
message  from 
customer 

Selective 

attention 

determine  if  new 

information 
requires 
attention  or 

action 

Salience,  Rate  of  Change  in 
Feed,  Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Detect 

determine  if  new 

information 
requires 
attention  or 

action 

Perceptual 

sensitivity 

recognize  and 
apply  label  to 
new  information 

Expertise,  Expectations, 
Salience,  Rate  of  Change  in 
Feed 

Distributed 

attention 

Identify 

recognize  and 
apply  label  to 
new  information 

Perceptual 

discrimination 

receive  message 
from  customer 

Expertise,  Number  of  Cues, 
Rates  of  Change  in  Feed, 
Situation  Awareness,  Time 
Constraints 

Long-term 

memory 

Working 

memory 

Message  receive  message  Response  start  process  to  Expertise,  Knowledge, 

from  customer  precision  handle  new  Quality  of  Oral 

information  Communication,  Quality  of 

Chat  Room 

Queue  to 
Channel 

start  process  to 
handle  new 

information 

Working 

memory 

translate  the 

written  or  verbal 

new  information 
message  to 
mentally  create  a 
visual  for 
inspection 

Time  Constraints, 
Computational  aid,  Activity 
Levels,  Expertise, 

Knowledge,  Vigilance, 
Situation  Awareness, 
Expectations 

Processing 

strategy 

Code 

translate  the 

written  or  verbal 

new  information 
message  to 
mentally  create  a 
visual  for 
inspection 

Response 

precision 

keep  new 
information  for 

future  visual 
inspections 

Aid,  Expertise,  Knowledge, 
Expectations 
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Working 

memory 

Long-term 

memory 

Store 

keep  new 

Working 

determine  what 

Time  Constraints,  Activity 

information  for 

memory 

to  do  with  new 

Levels,  Expertise 

future  visual 
inspections 

information 

Long-term 

memory 

Compute 

determine  what 

Processing 

get  rid  of  all  past 

Computational  Aid,  Quality 

to  do  with  new 

strategy 

data  unrelated  to 

of  Communication  Feed, 

information 

new  information 

Time  Constraints, 

Competing  Chat  Rooms, 
Competing  Transmissions, 
Expertise,  Knowledge, 
Vigilance 

Working 

memory 

Purge 

get  rid  of  all  past 

Selective 

reacting  to  new 

Expertise 

data  unrelated  to 

attention 

information 

new  information 

according  to  plan 

Control 

reacting  to  new 

Response 

respond  to  new 

Expertise,  Knowledge, 

information 
according  to  plan 

precision 

information 

Situation  Awareness 

Decide/Select 

respond  to  new 

Long-term 

follow  process 

Expertise,  Knowledge, 

information 

memory 

when  new 

Situation  Awareness, 

information  is 

Expectations 

given 

Processing 

strategy 

Plan 

follow  process 

Working 

interpret  new 

Expertise,  Knowledge, 

when  new 

information  is 
given 

memory 

information 

Expectations 

Processing 

determining  what 

strategy 

the  customer 

needs 

Interpret 

interpret  new 

Long-term 

appropriate  and 

Quality  of  Communication 

information 

memory 

optimal  reaction 

Feed,  Expertise, 

to  customer  with 

new  information 

Knowledge,  Expectations 

determining  what 

Sustained 

the  customer 

needs 

attention 

Adapt/Learn 

appropriate  and 

Long-term 

efficient  use  of 

Expertise,  Knowledge, 

optimal  reaction 

memory 

new  information 

Time  Constraints, 
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to  customer  with 

new  information 

to  complete 
mission 

Competing  Transmissions, 
Activity  Levels 

Goal  Image 

efficient  use  of 

new  information 
to  complete 
mission 

Long-term 

memory 

Quality  of  Communication, 
Activity  Levels,  Competing 
Transmissions,  Expertise, 
Expectations,  Knowledge 

Processing 

strategy 

Cognitive  Agent  Input  Human 

Task  Information 

Processing 

Resources 

Output  Task  and 

Environmental 

Demand 

Input  Select 

pay  attention  to  visual 
needs  due  to 

customer's  redirection 

Selective 

attention 

determine  if  redirection 
requires  different  visual 
data 

Salience,  Rate 
of  Change  in 
Feed,  Visibility, 
Activity  Levels, 
Expertise 

Perceptual 

sensitivity 

Detect 

determine  if  redirection 
requires  different  visual 
data 

Perceptual 

sensitivity 

select  visual  data 

needed  based  on 

customer  redirection 

Expertise, 
Expectations, 
Salience,  Rate 
of  Change  in 
Feed 

Distributed 

attention 

Search 

select  visual  data 

needed  based  on 

customer  redirection 

Sustained 

attention 

recognize  and  apply 
label  to  customer 

redirection 

Display 

Representation 
,  Expertise, 
Activity  Levels, 
Quality  of 
Communicatio 

n  Feed 

Perceptual 

sensitivity 

Identify 

recognize  and  apply 
label  to  customer 

redirection 

Perceptual 

discriminatio 

n 

receive  redirection 
message  from  customer 

Expertise, 
Number  of 
Cues,  Rates  of 
Change  in 

Feed,  Situation 

Awareness, 

Time 

Constraints 

Long-term 

memory 
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Working 

memory 

Message 

receive  redirection 
message  from  customer 

Response 

precision 

start  process  to  get 
correct  visual  data 

Expertise, 
Knowledge, 
Quality  of  Oral 
Communicatio 
n,  Quality  of 

Chat  Room 

Queue  to 

start  process  to  get 

Working 

translate  the  written  or 

Time 

Channel 

correct  visual  data 

memory 

verbal  message  to 
mentally  create  a  visual 
for  inspection 

Constraints, 
Computational 
aid,  Activity 
Levels, 

Expertise, 

Knowledge, 

Vigilance, 

Situation 

Awareness, 

Expectations 

Processing 

strategy 


Code 

translate  the  written  or 
verbal  message  to 
mentally  create  a  visual 
for  inspection 

Response 

precision 

transfer  redirection 
message  to  aircraft 
operator  for  new  visual 
data 

Aid,  Expertise, 

Knowledge, 

Expectations 

Working 

memory 

Long-term 

memory 

Transmit 

transfer  redirection 

Response 

keep  redirection 

Quality  of 

message  to  aircraft 

precision 

information  for  future 

Communicatio 

operator  for  new  visual 

visual  inspections 

n  Feed, 

data 

Physical 

Action,  Time 

Constraints, 

Display 

Representation 
,  Competing 
Transmissions, 
Expertise, 
Knowledge 


Store 

keep  redirection 

Working 

keep  redirection 

Time 

information  for  future 

memory 

information  for  aircraft 

Constraints, 

visual  inspections 

operator's  needs 

Activity  Levels, 
Expertise 

Long-term 

memory 
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Store  in  Buffer 

keep  redirection 
information  for  aircraft 
operator's  needs 

Working 

memory 

determine  what  to  do 

with  customer's 

redirection 

Time 

Constraints, 
Activity  Levels 

Processing 

strategy 

Compute 

determine  what  to  do 

with  customer's 

redirection 

Processing 

strategy 

verbal  communication 

of  customer  redirection 
in  military  jargon  to 
aircraft  operator 

Computational 
Aid,  Quality  of 
Communicatio 
n  Feed,  Time 
Constraints, 
Competing 

Chat  Rooms, 

Competing 

Transmissions, 

Expertise, 

Knowledge, 

Vigilance 

Working 

memory 

Edit 

verbal  communication 

of  customer  redirection 
in  military  jargon  to 
aircraft  operator 

Long-term 

memory 

get  rid  of  all  past  data 
unrelated  to  new 

information 

Expertise, 

Knowledge, 

Expectations 

Selective 

attention 

Purge 

get  rid  of  all  past  data 
unrelated  to  new 

information 

Selective 

attention 

reacting  to  customer's 
redirection  according  to 
plan 

Expertise 

Control 

reacting  to  customer's 
redirection  according  to 
plan 

Response 

precision 

respond  to  customer's 
redirection 

Expertise, 

Knowledge, 

Stituation 

Awareness 

request  different  visual 
data 

Decide/Select 

respond  to  customer's 
redirection 

Long-term 

memory 

requests  of  aircraft 
operator  made  based 
on  past 

experiences/expectatio 

ns 

Expertise, 

Knowledge, 

Situation 

Awareness, 

Expectations 

request  different  visual 
data 

Processing 

strategy 

Plan 

requests  of  aircraft 
operator  made  based 
on  past 

experiences/expectatio 

ns 

Working 

memory 

interpret  customer's 
redirection  and  wants 

Expertise, 

Knowledge, 

Expectations 

Processing 

determining  what  the 
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strategy 

aircraft  operator  can  do 

Interpret 

interpret  customer's 

Long-term 

appropriate  and 

Quality  of 

redirection  and  wants 

memory 

optimal  reaction  to 

Communicatio 

customer  redirection 

n  Feed, 

for  different  images 

Expertise, 

Knowledge, 

Expectations 

determining  what  the 

Sustained 

aircraft  operator  can  do 

attention 

Adapt/Learn 


appropriate  and 
optimal  reaction  to 
customer  redirection 
for  different  images 


Long-term  efficient  use  of  aircraft 

memory  operator's  abilities  to 

complete  mission 


Expertise, 

Knowledge, 

Time 

Constraints, 
Competing 
Transmissions, 
Activity  Levels 


Goal  Image 

efficient  use  of  aircraft 

Long-term 

receive  different  images 

Quality  of 

operator's  abilities  to 

memory 

from  aircraft  operator 

Communicatio 

complete  mission 

n,  Activity 

Levels, 

Competing 

Transmissions, 

Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 


Mapping/  Change  Sensor  to  IR 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  possible 

Salience,  Rate 

visual  feed 

attention 

visual  distractions 

of  Change  in 

Feed,  Visibility, 
Activity  Levels, 
Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if  mapping 

Quality  of  Feed, 

possible  visual 

attention 

can  be  accomplished 

Visibility, 

distractions 

using  current  visual  feed 

Salience, 
Visibility,  Rate 
of  Change, 
Activity  Levels, 
Competing 
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Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determining  if 

Perceptual 

recognize  cues  for 

Expertise, 

mapping  can  be 
accomplished  using 
current  visual  feed 

sensitivity 

accurate  mapping 

Expectations 

Distributed 

attention 

Search 

search  for  cues  for 

Sustained 

recognize  cues  for 

Salience, 

accurate  mapping 

attention 

accurate  mapping 

Visibility, 

Activity  Levels, 
Expertise, 
Number  of 

Cues 

Perceptual 

sensitivity 

recognize  uncertainty 

Identify 

recognize  cues  for 

Perceptual 

change  to  different  visual 

Expertise, 

accurate  mapping 

discrimination 

feed  format 

Number  of 

Cues,  Rates  of 
Change  in 

Feed,  Situation 
Awareness 

recognize 

Long-term 

change  to  different  visual 

uncertainty 

memory 

feed  sensor 

Working 

memory 

Control 

change  to  different 

Response 

choose IR  sensor 

Expertise, 

visual  feed  sensor 

precision 

Visibility, 

Quality  of  Feed, 
Rate  of  Change, 
Expectations 

Decide/Select 

choose IR  sensor 

Long-term 

expectations  of  IR  format 

Number  of 

memory 

Competing 

Feeds,  Amount 
of  Activity, 
Expertise, 
Visibility, 
Quality  of  Feed, 
Rate  of  Change, 
Expectations 


Processing 

strategy 

Plan 

expectations  of  IR 

Working 

responding  to  uncertainty 

Expectations, 

format 

memory 

in  mapping 

Expertise 
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Processing 

strategy 

Adapt/Learn 

responding  to 

Long-term 

efficient  mapping  to 

Expertise, 

uncertainty  in 

memory 

complete  mission 

Knowledge, 

mapping 

Number  of 

Cues,  Time 
Constraints 

using  all  resources  to 
accurately  map  visual 
feed 

Goal  Image 

efficient  mapping  to 

Long-term 

use  IR  sensor  for 

Quality  of  Feed, 

complete  mission 

memory 

successful  mission 

Salience, 
Visibility,  Rate 
of  Change, 
Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 

Expectations, 

Knowledge 

using  all  resources 

Processing 

to  accurately  map 
visual  feed 

strategy 
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Feeds,  Amount 
of  Activity, 
Expertise, 
Visibility, 

Quality  of 

Feed,  Rate  of 

Change, 

Expectations 

Processing 

strategy 

Control 

begin  new  scan 

Response 

need  for  further 

Expertise, 

Precision 

investigation  of  other 

Knowledge, 

CIED  activities  within 

Number  of 

watch  window 

Cues,  Time 
Constraints 

Interpret 

need  for  further 

Long-term 

thorough  inspection  of  all 

Expertise, 

investigation  of 

memory 

possible  CIED  activities  to 

Knowledge, 

other  CIED  activities 

complete  mission 

Number  of 

within  watch 

window 

Cues 

Sustained 

attention 

Goal  Image 

thorough  inspection 

Long-term 

make  judgment  on  IR 

Quality  of 

of  all  possible  CIED 

memory 

data  to  complete  mission 

Feed,  Salience, 

activities  to 

Visibility,  Rate 

complete  mission 

of  Change, 
Activity  Levels, 
Competing 
Watch  Window 
or  Feeds, 

Number  of 

Cues, 

Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 

Mapping/Determine  Time  Created 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to  IR 

Selective 

filter  out  irrelevant  visual 

Salience,  Rate 

sensor  data 

attention 

distractions 

of  Change  in 
Feed,  Visibility, 
Activity  Levels, 
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Expertise 

Perceptual 

sensitivity 


Filter 

filter  out  irrelevant 

visual  distractions 

Selective 

attention 

search  for  anomalies 

within  data 

Quality  of 

Feed,  Visibility, 
Salience, 
Visibility,  Rate 
of  Change, 
Activity  Levels, 
Competing 
Watch  Window 
or  Feeds, 

Number  of 

Cues, 

Expertise, 

Expectations 

Search 

search  for 

Sustained 

recognize  and  label 

Salience, 

anomalies  within 

attention 

anomaly 

Visibility, 

data 

Activity  Levels, 

Expertise, 
Number  of 
Cues 


Perceptual 

sensitivity 

Identify 

recognize  and  label 

Perceptual 

process  anomaly 

Expertise, 

anomaly 

discrimination 

information 

Number  of 

Cues,  Rates  of 
Change  in 

Feed,  Situation 
Awareness 

Long-term 

process  of  anomaly  time 

memory 

detection 

Working 

memory 

Queue  to 

process  anomaly 

Working 

save  anomaly 

Time 

Channel 

information 

memory 

information  for  time 

Constraints, 

detection 

Computational 
aid,  Activity 
Levels, 

Expertise, 

Knowledge, 

Vigilance, 

Situation 

Awareness, 

Expectations 

process  of  anomaly 

Processing 

time  detection 

strategy 
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Store  in  Buffer 

save  anomaly 
information  for  time 

detection 

Working 

memory 

figure  out  timing  of 
creation 

Computational 
Aid,  Time 
Constraints 

Processing 

strategy 

Compute 

figure  out  timing  of 
creation 

Processing 

strategy 

focus  on  time  of  creation 
only 

Computational 
Aid,  Time 
Constraints, 
Expertise 

Working  determine  time  of 

memory  creation 

Purge 

focus  on  timing  of 
anomaly  only 

Selective 

attention 

efficient  data  analysis  of 
time  of  creation  of  data 
to  complete  mission 

Expertise 

focus  on  anomaly 
information 

Decide/Select 

determine  time  of 

creation 

Long-term 

memory 

plan  on  how  to 
determine  time  of 

creation  based  on 

available  resources 

Number  of 
Competing 

Feeds,  Amount 
of  Activity, 
Expertise, 
Visibility, 

Quality  of 

Feed,  Rate  of 

Change, 

Expectations 

Processing 

strategy 


Plan 

plan  on  how  to 

Working 

response  to  anomaly 

Expectations, 

determine  time  of 

memory 

detection  in  IR  data 

Expertise 

creation  based  on 

available  resources 

Processing 

strategy 


Adapt/Learn 

response  to 

Long-term 

efficient  data  analysis  of 

Expertise, 

anomaly  detection 
in  IR  data 

memory 

time  of  creation  of  data 
to  complete  mission 

Knowledge, 
Number  of 

Cues,  Time 
Constraints 

using  all  resources  to 
accurately  determine 
time  of  creation  in  data 


Goal  Image 

efficient 

Long-term 

determine  time  of 

Quality  of 

determination  of 

memory 

creation  for  successful 

Feed,  Salience, 

time  creation  of 

mission 

Visibility,  Rate 

data  to  complete 

of  Change, 

mission 

Activity  Levels, 
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Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues, 

Expertise, 

Expectations, 

Knowledge 

using  all  resources  Processing 

to  accurately  strategy 

determine  time  of 

creation  in  data 

Mapping/  Visual  Inspection  to  Compare 

Cognitive  Input 

Agent  Task 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  possible 

Salience,  Rate 

visual  feed 

attention 

visual  distractions 

of  Change  in 

Feed,  Visibility, 
Activity  Levels, 
Expertise 

Perceptual 

sensitivity 


Filter 

filter  out  rest  of 
possible  visual 
distractions 

Selective 

attention 

determining  time  of 
creation 

Quality  of  Feed, 
Visibility, 

Salience, 

Visibility,  Rate 
of  Change, 

Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 
Expectations 

Detect  use  cues  to  Perceptual  search  for  provided  Expertise, 

determine  time  of  sensitivity  geolocation  Expectations 

creation 

Distributed 

attention 

search  shadow  cues  to 

determine  time 

search  google  earth 

Search 

search  for  provided 
geolocation 

Sustained 

attention 

recognize  and  label 
provided  geolocation 

Salience, 

Visibility, 

Activity  Levels, 
Expertise, 
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Number  of  Cues 

search  shadow  cues  Perceptual  recognize  and  label 

to  determine  time  sensitivity  shadow  cues 

search  google  earth 

recognize  and  label 
google  earth  cues 

Identify 

recognize  and  label 

provided 

geolocation 

Perceptual 

discrimination 

view  symbols  from 
provided  geolocation 

Expertise, 

Number  of 

Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

recognize  and  label 

Long-term 

view  shadow  cues 

shadow  cues 

memory 

recognize  and  label 

Working 

view  google  earth  cues 

google  earth  cues 

memory 

Message 

view  symbols  from 

Response 

processing  of  provided 

Expertise, 

provided 

precision 

geolocation 

Knowledge, 

geolocation 

Quality  of  Oral 

Communication, 

Quality  of  Chat 

Room 

view  shadow  cues 

processing  of  shadow 

cues 

view  google  earth 

processing  of  google 

cues 

earth  cues 

Queue  to 

processing  of 

Working 

translating  provided 

Time 

Channel 

provided 

memory 

geolocation 

Constraints, 

geolocation 

Computational 

aid,  Activity 

Levels, 

Expertise, 

Knowledge, 

Vigilance, 

Situation 

Awareness, 

Expectations 


processing  of 
shadow  cues 

Processing 

strategy 

translating  shadow  cues 

processing  of  google  translating  google  earth 

earth  cues  cues 

Code 

translating  provided 
geolocation 

Response 

precision 

saving  provided 
geolocation 

Computational 
Aid,  Expertise, 
Knowledge, 
Expectations 

translating  shadow 

cues 

Working 

memory 

saving  shadow  cues 

translating  google 

Long-term 

saving  google  earth  cues 
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earth  cues 

memory 

Store  in  Buffer  saving  provided  Working  compare  images  based  Computational 

geolocation  memory  on  selected  cue  Aid,  Time 

Constraints 

saving  shadow  cues 

Processing 

strategy 

saving  google  earth 

cues 

Decide/Select 

compare  images 
based  on  selected 

cue 

Long-term 

memory 

response  to  which  cue  to 
use  in  visual  inspection 

Number  of 
Competing 

Feeds,  Amount 
of  Activity, 
Expertise, 
Visibility, 

Quality  of  Feed, 
Rate  of  Change, 
Expectations 

Processing 

strategy 

Adapt/Learn 

response  to  which 
cue  to  use  in  visual 
inspection 

Long-term 

memory 

efficient  visual 
inspection  of  past  data 
to  complete  mission 

Expertise, 
Knowledge, 
Number  of 

Cues,  Time 
Constraints 

using  all  resources  to 
accurately  determine 
creation  time  of  data 

Goal  Image 

efficient  visual 
inspection  of  past 
data  to  complete 
mission 

Long-term 

memory 

determine  time  of 

creation  for  successful 

mission 

Quality  of  Feed, 
Salience, 

Visibility,  Rate 
of  Change, 

Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 

Expectations, 

Knowledge 

using  all  resources  Processing 

to  accurately  strategy 

determine  creation 

time  of  data 
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Mapping/  Determine  Significance  Based  on  Time 


Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Identify 

recognize  and  label 

Perceptual 

keep  relevant 

Expertise, 

comparison  of  data 

discrimination 

information  saved 

Number  of 

Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

recognize  and  label 

Long-term 

store  information  on 

time  of  creation 

memory 

time  of  creation 

Working 

memory 

Store  in  Buffer 

keep  relevant 

Working 

figure  out  if  comparison 

Computational 

information  saved 

memory 

is  significant 

Aid,  Time 
Constraints 

store  information 

Processing 

on  time  of  creation 

strategy 

Compute 

figure  out  if 

Processing 

normal  or  abnormal 

Computational 

comparison  is 

strategy 

comparison 

Aid,  Time 

significant 

Constraints, 

Expertise 

Working 

memory 

Decide/Select 

normal  or  abnormal 

Long-term 

continue  to  match  to 

Number  of 

comparison 

memory 

normal  comparison 

Competing 

Feeds,  Amount 
of  Activity, 
Expertise, 
Visibility, 
Quality  of  Feed, 
Rate  of  Change, 
Expectations 


Processing 

continue  to  match  to 

strategy 

abnormal  comparison 

Plan 

match  to  normal 

Working 

test  current  behavior 

Expectations, 

comparison 

memory 

being  observed  to 
normal 

Expertise 

match  to  abnormal 

Processing 

test  current  behavior 

comparison 

strategy 

being  observed  to 
abnormal 

Test 

test  comparison  to 

Perceptual 

no  significance  of 

Knowledge, 

knowledge  of 
normal 

sensitivity 

comparison 

Expertise 

test  comparison  to 

Working 

significance  of 
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knowledge  of 
abnormality 

memory 

comparison 

Long-term 

memory 

Interpret 

no  significance  of 

Long-term 

ignore  if  no  significance 

Expertise, 

comparison 

memory 

Knowledge, 
Number  of  Cues 

significance  of 

Sustained 

contact  customer  if 

comparison 

attention 

determined  significant 

Categorize 

ignore  if  no 

Long-term 

continue  scanning  for 

Expertise, 

significance 

memory 

POL  activity 

Knowledge, 
Number  of  Cues 

contact  customer  if 

Perceptual 

communicate  with 

determined 

significant 

sensitivity 

customer 

document  for  final 
product  report 

Adapt/Learn 

appropriate 

Long-term 

efficient  visual 

Expertise, 

response  if 

memory 

inspection  of 

Knowledge, 

determined  non- 

significance  to  complete 

Number  of 

significant 

mission 

Cues,  Time 
Constraints 

appropriate 

efficient  mapping  to 

response  if 
determined 
significant 

complete  mission 

Goal  Image 

efficient  visual 

Long-term 

continue  scanning  for 

Quality  of  Feed, 

inspection  of 

memory 

POL  activity 

Salience, 

significance  to 

Visibility,  Rate 

complete  mission 

of  Change, 

Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 

Expectations, 

Knowledge 

efficient  mapping  to 

Processing 

communicate  with 

complete  mission 

strategy 

customer 

document  for  final 
product  report 
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KML  Loaded  with  Markers/Look  at  Historical  Data 


Cognitive  Input  Human  Output 

Agent  Task  Information 

Processing 

Resources 

Task  & 

Environmental 

Demands 

Input  Select 

visually  pay 
attention  to  KML 

data 

Selective 

attention 

filter  out  irrelevant 

markers 

Salience,  Rate  of 
Change  in  Feed, 
Visibility, 

Activity  Levels, 
Expertise 

pay  attention  to  Perceptual 

markers  sensitivity 

Filter 

filter  out 

irrelevant  markers 

Selective 

attention 

determine  cues  to  help 
with  current  mission 

Quality  of  Feed, 
Visibility, 

Salience, 

Visibility,  Rate  of 
Change,  Activity 
Levels, 

Competing 

Watch  Window 
or  Feeds, 

Number  of  Cues, 

Expertise, 

Expectations 

Detect  determine  cues  to  Perceptual  recognize  and  label  Expertise, 

help  with  current  sensitivity  relevant  markers  Expectations 

mission 

Distributed 

attention 

Identify  recognize  and  Perceptual  save  relevant  information  Expertise, 

label  relevant  discrimination  for  future  use  Number  of  Cues, 

markers  Rates  of  Cha  nge 

in  Feed, 

Situation 

Awareness 

Long-term 

memory 

Working  memory 

Store 

save  relevant 

information  for 

future  use 

Working  memory 

response  to  KML  data 

Aid,  Time 
Constraints 

Long-term 

memory 

Adapt/Learn 

response  to  KML 
data 

Long-term 

memory 

efficient  visual  inspection 
of  KML  data  to  complete 
mission 

Expertise, 
Knowledge, 
Number  of  Cues, 
Time  Constraints 
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efficient  determination  of 
relevancy  of  markers  to 
complete  mission 


Goal  Image 

efficient  visual 

Long-term 

Quality  of  Feed, 

inspection  of  KML 

memory 

Salience, 

data  to  complete 

Visibility,  Rate  of 

mission 

Change,  Activity 
Levels, 

Competing 

Watch  Window 
or  Feeds, 

Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

efficient 

Processing 

review  historical  data 

determination  of 

strategy 

relevancy  of 
markers  to 
complete  mission 


Look  at  Historical  Data/Communication 

Cognitive 

Input 

Human 

Output 

Task  & 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

visually  pay 

Selective  attention 

filter  out  irrelevant  data 

Salience,  Rate  of 

attention  to 

Change  in  Feed, 

historical  data 

Visibility, 

Activity  Levels, 
Expertise 

focus  on  defining 

Perceptual 

starting  point  for 
scanning  AOI 

sensitivity 

Filter 

filter  out 

Selective  attention 

determine  relevant  data 

Quality  of  Feed, 

irrelevant  data 

Visibility, 

Salience, 

Visibility,  Rate 
of  Change, 

Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determine 

Perceptual 

search  for  relevant  data 

Expertise, 
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relevant  data 

sensitivity 

Expectations 

Distributed 

attention 

Search 

search  for 

relevant  data 

Sustained 

attention 

recognize  and  label 
relevant  data 

Salience, 

Visibility, 

Activity  Levels, 
Expertise, 

Number  of  Cues 

Perceptual 

sensitivity 

Identify  recognize  and  Perceptual  create  message  based  on  Expertise, 

label  relevant  data  discrimination  relevant  data  Number  of 


Cues,  Rates  of 
Change  in  Feed, 
Situation 
Awareness 


Long-term 

memory 

Working  memory 

Message 

create  message 
based  on  relevant 

data 

Response  precision 

translate  relevant  data 

into  wriiten  or  verbal 

message 

Expertise, 
Knowledge, 
Quality  of  Oral 
Communication, 
Quality  of  Chat 
Room 

Code  translate  relevant  Response  precision  type  message  into  Aid,  Expertise, 

data  into  wriiten  chatroom  Knowledge, 

or  verbal  message  Expectations 

Working  memory 

use  teamspeak  for  verbal 
message 

Long-term 

memory 

Transmit 

type  message  into 
chatroom 

Response  precision 

arrange  message  into 
military  jargon 

Quality  of 
Communication 
Feed,  Physical 
Action,  Time 
Constraints, 
Display 

Representation, 

Competing 

Transmissions, 

Expertise, 

Knowledge 

use  teamspeak  for 
verbal  message 

Store  in  Buffer 

save  relevant  data 

Working  memory 

arrange  message  into 
military  jargon 

Computational 
Aid,  Time 
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Constraints 

Processing 

strategy 

Edit 

arrange  message 
into  military 
jargon 

Long-term 

memory 

create  an  accurate 
message  that  can  be 
understood  by  recipient 

Expertise, 

Knowledge, 

Expectations 

Selective  attention 

Display 

create  an  accurate 
message  that  can 
be  understood  by 
recipient 

Response  precision 

communicate  with 
recipient 

Expertise, 
Knowledge, 
Quality  of 
Communication 
Feed, 

Competing 

Transmissions 

Decide/Select 

communicate  with 
recipient 

Long-term 

memory 

response  to  relevant 
historical  data 

Number  of 
Competing 

Feeds,  Amount 
of  Activity, 
Expertise, 
Visibility, 

Quality  of  Feed, 
Rate  of  Change, 
Expectations 

Processing 

strategy 

Adapt/Learn 

response  to 
relevant  historical 

data 

Long-term 

memory 

efficient  determination 

of  historical  data 
relevancy  to  complete 
mission 

Expertise, 
Knowledge, 
Number  of 

Cues,  Time 
Constraints 

efficient  determination 
of  starting  point  for 
scanning  to  complete 
mission 

Goal  Image 

efficient 

determination  of 

historical  data 
relevancy  to 
complete  mission 

Long-term 

memory 

communication  with 
recipient 

Quality  of  Feed, 
Salience, 

Visibility,  Rate 
of  Change, 

Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 

Expectations, 

Knowledge 

122 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


efficient 

Processing 

determination  of 

strategy 

starting  point  for 

scanning  to 

complete  mission 

Look  at  Historical  Data/Look  in  Local  Image  Base 

Cognitive  Input  Human  Output  Task& 

Agent  Task  Information  Environmental 

Processing  Demands 

Resources 

Input  Select 

visually  pay 
attention  to  KML 

data 

Selective  attention 

filter  out  irrelevant 
activity 

Salience,  Rate  of 
Change  in  Feed, 
Visibility, 

Activity  Levels, 
Expertise 

pay  attention  to  Perceptual 

local  images  sensitivity 

Filter 

filter  out 

irrelevant  activity 

Selective  attention 

determine  cues  to  help 
with  current  mission 

Quality  of  Feed, 
Visibility, 

Salience,  Rate  of 
Change,  Activity 
Levels, 

Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 
Expectations 

Detect  determine  cues  to  Perceptual  recognize  and  label  Expertise, 

help  with  current  sensitivity  relevant  activity  Expectations 

mission 

Distributed 

attention 

Identify  recognize  and  Perceptual  save  relevant  Expertise, 

label  relevant  discrimination  information  for  future  Number  of 

activity  use  Cues,  Rates  of 

Change  in  Feed, 
Situation 

Awareness 

Long-term  memory 

Working  memory 

Store 

save  relevant 

information  for 

future  use 

Working  memory 

response  to  local  image 
data 

Aid,  Time 
Constraints 

Long-term  memory 
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Adapt/Learn 

response  to  local 

Long-term  memory 

efficient  visual 

Expertise, 

image  data 

inspection  of  local 

Knowledge, 

image  data  to  complete 

Number  of 

mission 

Cues,  Time 

Constraints 

efficient  determination 
of  relevancy  of  local 
image  data  activity  to 
complete  mission 


Goal  Image 

efficient  visual 

Long-term  memory 

Quality  of  Feed, 

inspection  of  local 

Salience, 

image  data  to 

Visibility,  Rate 

complete  mission 

of  Change, 

Activity  Levels, 
Competing 

Watch  Window 
or  Feeds, 

Number  of 

Cues,  Expertise, 

Expectations, 

Knowledge 

efficient  Processing  strategy  review  local  historical 

determination  of  data 

relevancy  of  local 

image  data 

activity  to 

complete  mission 
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Expertise, 

Expectations 

Detect 

determining  if 
structure  requires 
attention 

Perceptual 

sensitivity 

search  for  permanent 
environmental 

structures  within 

Expertise, 

Expectations 

visual  data 


Distributed 

attention 

Search 

search  for 

Sustained  attention 

recognize  and  label 

Salience,  Visibility, 

permanent 

structures 

Activity  Levels, 

environmental 

Expertise,  Number 

structures  within 

visual  data 

of  Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information  on 

Expertise,  Number 

label  structures 

discrimination 

structures 

of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

Long-term  memory 

Working  memory 

Store  in  Buffer 

store  information 

Working  memory 

track  number  of 

Computational  Aid, 

on  structures 

structures 

Time  Constraints 

Processing  strategy 

Count 

track  number  of 

Sustained  attention 

expectations  of 

Number  of 

structures 

structures 

Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of 

Working  memory 

define  structure 

Expectations, 

structures 

Expertise 

Processing  strategy 

Categorize 

define  religious 

Long-term  memory 

appropriate  and 

Expertise, 

structure 

optimal  reaction  to 

Knowledge, 

permanent 

environmental 

structures 

Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 

Long-term  memory 

efficient  visual 

Expertise, 

optimal  reaction 

inspection  of  local 

Knowledge, 

to  permanent 

images  to  complete 

Number  of  Cues, 

environmental 

structures  in  local 
image  data  base 

mission 

Time  Constraints 

Goal  Image 

efficient  visual 

Long-term  memory 

further  inspection 

Quality  of  Feed, 
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inspection  of  local 
images  to 
complete  mission 


needed  to  determine 
significance  with 
FMV  feed 


Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing  strategy 
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Long-term 

memory 

Working  memory 

Store  in  Buffer 

store  information 

on  structures 

Working  memory 

track  number  of 

structures 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Count 

track  number  of 

structures 

Sustained 

attention 

expectations  of 
structures 

Number  of 
Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of 
structures 

Working  memory 

define  structure 

Expectations, 

Expertise 

Processing 

strategy 

Categorize 

define  religious 
structure 

Long-term 

memory 

appropriate  and 
optimal  reaction  to 
structures  in  local 
images 

Expertise, 

Knowledge, 

Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
structures  in  local 
image  data  base 

Long-term 

memory 

efficient  visual 
inspection  of  local 
images  to  complete 
mission 

Expertise, 

Knowledge, 

Number  of  Cues, 
Time  Constraints 

Goal  Image  efficient  visual  Long-term  further  inspection  Quality  of  Feed, 

inspection  of  local  memory  needed  to  determine  Salience,  Visibility, 

images  to  complete  significance  with  Rate  of  Change, 

mission  FMV  feed  Activity  Levels, 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing 

strategy 

Customer  Gives  AOI(s)/  Define  Starting  Point(s) 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 

AOI  given 

Selective 

attention 

recognize  AOI 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
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Levels,  Expertise 

pay  attention  to  Perceptual  recognize  CIED 

new  CIED  activity  sensitivity  activity 

Identify 

recognize  AOI 

Perceptual 

discrimination 

keep  location  of  AOI 
for  future  use 

Expertise,  Number 
of  Cues,  Rates  of 
Change  in  Feed, 
Situation 

Awareness 

recognize  CIED  Long-term  keep  CIED  activity  for 

activity  memory  future  use 

Working  memory 

Store  keep  location  of  Working  memory  compute  starting  Computational  Aid, 

AOI  for  future  use  point  for  scanning  Time  Constraints 

watch  windows 

based  on  location  of 

AOI 

keep  CIED  activity 
for  future  use 

Long-term 

memory 

compute  starting 
point  for  scanning 
watch  windows 

based  on  CIED 
activity 

Compute  compute  starting  Processing  choose  starting  point  Computational  Aid, 

point  for  scanning  strategy  Time  Constraints, 

watch  windows  Expertise 

Working  memory 

if  starting  scan  for 
new  CIED  activity  get 
rid  of  old  CIED 
activity  details 

Purge  if  starting  scan  for  Selective  choose  starting  point  Expertise 

new  CIED  activity  attention 

get  rid  of  old  CIED 
activity  details 

Decide/Select 

choose  starting 
point 

Long-term 

memory 

to  efficiently  inspect 
CIED  activity  to 
complete  mission 

Number  of 
Competing  Feeds, 
Amount  of  Activity, 
Expertise,  Visibility, 
Quality  of  Feed, 

Rate  of  Change, 
Expectations 

Processing 

strategy 

Goal  Image 

ability  to  efficiently 
inspect  CIED 
activity  to 
complete  mission 

Long-term 

memory 

define  starting  points 
to  inspect  CIED 
activity 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
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Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

Processing 

strategy 

Define  Starting  Point(s)/  Slow  Scan 

Cognitive 

Example 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest 

Salience,  Rate  of  Change  in 

potential  CIED 

attention 

of  activity  in 

Feed,  Visibility,  Activity 

activities 

watch 

window 

Levels,  Expertise 

pay  attention  to 

Perceptual 

target 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determine  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

activity 

Salience,  Visibility,  Rate  of 

window 

requires 

Change,  Activity  Levels, 

attention 

Competing  Watch  Window  or 
Feeds,  Number  of  Cues, 
Expertise,  Expectations 

Detect 

determine  if 

Perceptual 

slowly 

Expertise,  Expectations 

activity  requires 

sensitivity 

search  for 

attention 

only  CIED 
activities 

Distributed 

attention 

Search 

slowly  search  for 

Sustained 

recognize 

Salience,  Visibility,  Activity 

only  CIED  activities 

attention 

and  label 

Levels,  Expertise,  Number  of 

activities 

Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store 

Expertise,  Number  of  Cues, 

label  activities 

discrimination 

relevant 

Rates  of  Change  in  Feed, 

information 
on  activity 

Situation  Awareness 

Long-term 

memory 

Working  memory 


Store  in 

store  relevant 

Working  memory 

figure  out  if 

Computational  Aid,  Time 

Buffer 

information  on 

activity  is 

Constraints 

activity 

CIED 

Processing 
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strategy 

Compute 

figure  out  if 
activity  is  CIED 

Processing 

strategy 

expectations 
of  a  CIED 
activity 

Computational  Aid,  Time 
Constraints,  Expertise 

Working  memory 

Count 

keep  track  of 
number  of 

individual's 
performing  activity 

Sustained 

attention 

expectations 
of  a  CIED 
activity 

Number  of  Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of  a 
CIED  activity 

Working  memory 

determine 
meaning  of 
activity 
observed 

Expectations,  Expertise 

Processing 

strategy 

Interpret 

determine 
meaning  of  activity 
observed 

Long-term 

memory 

define  and 

name 

activity  as 

CIED 

Expertise,  Knowledge, 

Number  of  Cues 

Sustained 

attention 

Categorize 

define  and  name 
activity  as  CIED 

Long-term 

memory 

inspect  CIED 
activity 

Expertise,  Knowledge, 

Number  of  Cues,  Quality  of 
Feed,  Expectations 

Perceptual 

sensitivity 

communicat 

e  with 

customer 

Adapt/Learn 

responses  to 
certain  activity 

Long-term 

memory 

confirming 
CIED  activity 

Expertise,  Knowledge, 

Number  of  Cues,  Time 
Constraints 

reason  to 

communicat 

e 

Goal  Image 

inspect  CIED 
activity 

Long-term 

memory 

further 
scanning  for 
inspection  of 
CIED  activity 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations,  Knowledge 

communicate  with 

customer 

Processing 

strategy 
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Define  Starting  Point(s)/Scan  Left  to  Right 


Cognitive 

Example 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 
potential  CIED 
activities 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change  in 
Feed,  Visibility,  Activity 

Levels,  Expertise 

pay  attention  to  Perceptual 
target  sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determine  if 
activity  requires 
attention 

Quality  of  Feed,  Visibility, 
Salience,  Visibility,  Rate  of 
Change,  Activity  Levels, 
Competing  Watch  Window  or 
Feeds,  Number  of  Cues, 
Expertise,  Expectations 

Detect  determine  if  Perceptual  slowly  search  for  Expertise,  Expectations 

activity  requires  sensitivity  only  CIED  activities 

attention 

Distributed 

attention 

Search  slowly  search  for  Sustained  recognize  and  Salience,  Visibility,  Activity 

only  CIED  attention  label  activities  Levels,  Expertise,  Number  of 

activities  Cues 

Perceptual 

sensitivity 

Identify  recognize  and  Perceptual  store  relevant  Expertise,  Number  of  Cues, 

label  activities  discrimination  information  on  Rates  of  Change  in  Feed, 

activity  Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store  relevant 

information  on 
activity 

Working 

memory 

figure  out  if 
activity  is  CIED 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Compute 

figure  out  if 
activity  is  CIED 

Processing 

strategy 

expectations  of  a 
CIED  activity 

Computational  Aid,  Time 
Constraints,  Expertise 

Working 

memory 

Count 

keep  track  of 
number  of 

individual's 

performing 

activity 

Sustained 

attention 

expectations  of  a 
CIED  activity 

Number  of  Competing  Feeds, 
Amount  of  Activity 
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Working 

memory 


Plan 

expectations  of  a 

Working 

determine 

Expectations,  Expertise 

CIED  activity 

memory 

meaning  of 

activity  observed 

Processing 

strategy 


Interpret 

determine 

Long-term 

define  and  name 

Expertise,  Knowledge, 

meaning  of 
activity  observed 

memory 

activity  as  CIED 

Number  of  Cues 

Sustained 

attention 


Categorize 

define  and  name 

Long-term 

inspect  CIED 

Expertise,  Knowledge, 

activity  as  CIED 

memory 

activity 

Number  of  Cues,  Quality  of 
Feed,  Expectations 

Perceptual 

communicate  with 

sensitivity 

customer 

Adapt/Learn 

responses  to 
certain  activity 

Long-term 

memory 

confirming  CIED 
activity 

Expertise,  Knowledge, 

Number  of  Cues,  Time 
Constraints 

reason  to 

communicate 

Goal  Image 

inspect  CIED 
activity 

Long-term 

memory 

further  scanning 
for  inspection  of 
CIED  activity 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations,  Knowledge 

communicate 

Processing 

with  customer 

strategy 

Scanning/Check  Terrain 

Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change  in 

terrain  cues 

attention 

activity  in  watch 

Feed,  Visibility,  Activity 

window 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed,  Visibility, 

activity  in  watch 

attention 

cue  requires 

Salience,  Rate  of  Change, 

window 

attention 

Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
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Number  of  Cues,  Expertise, 
Expectations 

Detect 

determining  if  cue 

Perceptual 

search  for  cues 

Expertise,  Expectations 

requires  attention 

sensitivity 

within  visual 

data 

Distributed 

attention 

Search 

search  for  cues 

Sustained 

recognize  and 

Salience,  Visibility,  Activity 

within  visual  data 

attention 

label  cues 

Levels,  Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and  label 

Perceptual 

store 

Expertise,  Number  of  Cues, 

cues 

discrimination 

information  on 

Rates  of  Change  in  Feed, 

cues 

Situation  Awareness 

Long-term 

memory 

Working 

memory 


Store  in 

store  information 

Working 

track  number  of 

Computational  Aid,  Time 

Buffer 

on  cues 

memory 

cues 

Constraints 

Processing 

strategy 


Count 

track  number  of 

Sustained 

expectations  of 

Number  of  Competing 

cues 

attention 

cues 

Feeds,  Amount  of  Activity 

Working 

memory 


Plan 

expectations  of 

Working 

define  cues 

Expectations,  Expertise 

cues 

memory 

Processing 

strategy 


Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  terrain  cues 

Expertise,  Knowledge, 

Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
terrain  cues 

Long-term 

memory 

efficient  visual 
inspection  of 
terrain  cues  to 
complete 
mission 

Expertise,  Knowledge, 

Number  of  Cues,  Time 
Constraints 

Goal  Image 

efficient  visual 
inspection  of  terrain 
cues  to  complete 
mission 

Long-term 

memory 

further 
inspection 
needed  to 

determine 
significance  with 
FMV  feed 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations,  Knowledge 
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Processing 

strategy 

Scanning/Check  for  Patterns  of  Life 

Cognitive  Input  Human  Output  Task  and  Environmental 

Agent  Task  Information  Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

POL  activity 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change  in 
Feed,  Visibility,  Activity 

Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if 
cue  requires 
attention 

Quality  of  Feed,  Visibility, 
Salience,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations 

Detect  determining  if  cue  Perceptual  search  for  cues  Expertise,  Expectations 

requires  attention  sensitivity  within  visual  data 

Distributed 

attention 

Search  search  for  cues  Sustained  recognize  and  Salience,  Visibility,  Activity 

within  visual  data  attention  label  cues  Levels,  Expertise,  Number 

of  Cues 

Perceptual 

sensitivity 

Identify  recognize  and  label  Perceptual  store  information  Expertise,  Number  of  Cues, 

cues  discrimination  on  cues  Rates  of  Change  in  Feed, 

Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

Buffer 

store  information 

on  cues 

Working 

memory 

track  number  of 

cues 

Computational  Aid,  Time 
Constraints 

Processing 

strategy 

Count 

track  number  of 

cues 

Sustained 

attention 

expectations  of 

cues 

Number  of  Competing 

Feeds,  Amount  of  Activity 

Working 

memory 

Plan 

expectations  of 

cues 

Working 

memory 

define  cues 

Expectations,  Expertise 

Processing 
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strategy 


Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  POL  activity 

Expertise,  Knowledge, 
Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
POL  activity 

Long-term 

memory 

efficient  visual 
inspection  of  POL 
activity  to 
complete  mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

Goal  Image 

efficient  visual 
inspection  of  POL 
activity  to  complete 
mission 

Long-term 

memory 

further  inspection 
needed  to 

determine 
significance  with 
FMV  feed 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues,  Expertise, 
Expectations,  Knowledge 

Processing 

strategy 

Scanning/Determine  Significance 

Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Identify 

recognize  and  label 

Perceptual 

keep  relevant 

Expertise,  Number  of 

POL  activity  under 

discrimination 

actions  saved 

Cues,  Rates  of  Change  in 

inspection  in  FMV 

Feed,  Situation 

Awareness 

recognize  and  label 

Long-term 

cues  under 
inspection  in  WAMI 

memory 

Working 

memory 

Store  in  Buffer 

keep  relevant 

Working 

figure  out  if 

Computational  Aid,  Time 

actions  saved 

memory 

activity  is 
significant 

Constraints 

Processing 

figure  out  if 

strategy 

activity  is  non¬ 
significant 

Compute 

figure  out  if  activity 

Processing 

track  people 

Computational  Aid,  Time 

is  significant 

strategy 

performing 

activity 

Constraints,  Expertise 

figure  out  if  activity 

Working 

is  non-significant 

memory 

Count 

track  people  under 

Sustained 

people 

Number  of  Competing 

inspection 

attention 

performing 

Feeds,  Amount  of  Activity 
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normal  or 
abnormal  activity 


Working 

memory 

Decide/Select  normal  or  Long-term  continue  to  Number  of  Competing 

abnormal  actions  memory  match  to  normal  Feeds,  Amount  of 

observed  Activity,  Expertise, 

behavior  Visibility,  Quality  of  Feed, 


Rate  of  Change, 
Expectations 


Processing 

strategy 

continue  to 

match  to 

abnormal 

observed 

behavior 

Plan  match  to  normal  Working  test  current  Expectations,  Expertise 

observed  activities  memory  behavior  being 


observed  to 
normal 


match  to  abnormal 

Processing 

test  current 

observed  activities 

strategy 

behavior  being 

observed  to 

abnormal 

Test  test  activity  being  Perceptual  potential  need  Knowledge,  Expertise 


performed  to  sensitivity  for  further 

knowledge  of  a  investigation 

normal  activity 


test  activity  being 
performed  to 
knowledge  of  an 
abnormal  activity 

Working 

memory 

Long-term 

memory 

Interpret 

potential  need  for 
further 

investigation  based 
on  interpretation 

Long-term 

memory 

reason  for  action 

Expertise,  Knowledge, 
Number  of  Cues 

Sustained 

attention 

Categorize 

reason  for  action 

Long-term 

memory 

efficient  visual 
inspection  of 
actions  to 
complete  mission 

Expertise,  Knowledge, 
Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 

Long-term 

memory 

efficient 
significance  of 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
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actions  performed 

activity 

determined  to 
complete  mission 

Constraints 

Goal  Image 

efficient 

Long-term 

determined 

Quality  of  Feed,  Salience, 

significance  of 

memory 

significant 

Visibility,  Rate  of  Change, 

activity  determined 

Activity  Levels,  Competing 

to  complete 

Watch  Window  or  Feeds, 

mission 

Number  of  Cues, 

Expertise,  Expectations, 
Knowledge 

Processing 

determined  non- 

strategy 

significant 

document  for 
final  product 
report 

B.3  Threat  to  Convoy  OFM-COG  Table 

Communication/Request  Specific  Indications 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 
communication  feed 

Selective 

Attention 

specific 
indications 
requires  written 
or  verbal 

communication 
(through  chat 

room  or 

TeamSpeak)  to 
confirm 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

visually  pay  attention 
to  chat  rooms  instead 

of  video  feed 

Perceptual 

Sensitivity 

Detect 

specific  indications 
requires  written  or 
verbal  communication 
(through  chat  room  or 
TeamSpeak)  to 
confirm 

Perceptual 

Sensitivity 

recognize  and 
label  specific 
indications 

Expertise, 

Expectations, 

Salience,  Rate  of 
Change  in  Feed 

Distributed 

Attention 

Identify 

recognize  and  label 
specific  indications 

Perceptual 

Discrimination 

written  or  verbal 

communication 
(through  chat 

room  or 

TeamSpeak) 

Expertise,  Number  of 
Cues,  Rates  of 

Change  in  Feed, 
Situation  Awareness, 
Time  Constraints 
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Long-term 

Memory 

Working  Memory 

Message 

written  or  verbal 

Response 

requires 

Expertise, 

communication 

Precision 

communication 

Knowledge,  Quality 

(through  chat  room  or 

to  confirm 

of  Oral 

TeamSpeak) 

specific 

Communication, 

indications  then 
visual  inspection 

Quality  of  Chat  Room 

Queue  to 

requires 

Working  Memory 

determine  form 

Time  Constraints, 

Channel 

communication  to 

of 

Computational  aid, 

confirm  specific 

communication 

Activity  Levels, 

indications  then  visual 

needed  (written 

Expertise, 

inspection 

or  verbal) 

Knowledge, 

Vigilance,  Situation 

Awareness, 

Expectations 

Processing 

Strategy 

Code 

determine  form  of 

Response 

communicating 

Aid,  Expertise, 

communication 

Precision 

in  correct  format 

Knowledge, 

needed  (written  or 

to  appropriate 

Expectations 

verbal) 

correspondent(s) 

Working  Memory 

Long-term 

Memory 

Transmit 

communicating  in 

Response 

keep  specific 

Quality  of 

correct  format  to 

Precision 

indications  until 

Communication 

appropriate 

mission 

Feed,  Physical  Action, 

correspondent(s) 

complete 

Time  Constraints, 

Display 

Representation, 
Competing 
Transmissions, 
Expertise,  Knowledge 


Store  in  Buffer 

keep  specific 

Working  Memory 

plan  for  if 

Time  Constraints, 

indications  until 

specific 

Activity  Levels 

mission  complete 

indications  is 

confirmed  or  not 

Processing 

Strategy 


Edit 

use  military  jargon 

Long-term 

accurate  account 

Expertise, 

Memory 

of  information  in 

Knowledge, 

message 

Expectations 

Selective 

Attention 

Display 

accurate  account  of 

Response 

respond  to 

Expertise, 
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information  in 

Precision 

specific 

Knowledge,  Quality 

message 

indications  by 

of  Communication 

communication 

Feed,  Competing 
Transmissions 

Decide/Select 

respond  to  specific 

Long-term 

plan  for  if 

Expertise, 

indications  by 

Memory 

specific 

Knowledge,  Situation 

communication 

indications  is 

Awareness, 

confirmed  or  not 

Expectations 

Processing 

Strategy 

Plan 

plan  for  specific 

Working  Memory 

processing 

Expertise, 

indications 

specific 

Knowledge, 

indications 

Expectations 

Processing 

Strategy 

Adapt/Learn 

processing  specific 

Long-term 

investigate 

Expertise, 

indications  for  the 

Memory 

specific 

Knowledge,  Time 

mission 

indications  with 

Constraints, 

communication 

Competing 

Transmissions, 

Activity  Levels 

Goal  Image 

investigate  specific 

Long-term 

using 

Quality  of 

indications  with 

Memory 

communication 

Communication, 

communication 

to  confirm 

Activity  Levels, 

specific 

Competing 

indications 

Transmissions, 

Expertise, 

Expectations, 

Knowledge 

Processing 

Strategy 

Define  Starting  Point(s)/  Slow  Scan 

Cognitive 

Example 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of 

potential  convoy 

attention 

activity  in  watch 

Change  in  Feed, 

activities 

window 

Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 

Perceptual 

target 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determine  if 

Quality  of  Feed, 

activity  in  watch 

attention 

activity  requires 

Visibility,  Salience, 

window 

attention 

Visibility,  Rate  of 
Change,  Activity 
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Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determine  if  activity 

Perceptual 

slowly  search  for 

Expertise, 

requires  attention 

sensitivity 

only  convoy 
activities 

Expectations 

Distributed 

attention 

Search 

slowly  search  for  only 

Sustained 

recognize  and 

Salience,  Visibility, 

convoy  activities 

attention 

label  activities 

Activity  Levels, 
Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify  recognize  and  label  Perceptual  store  relevant  Expertise,  Number  of 

activities  discrimination  information  on  Cues,  Rates  of 

activity  Change  in  Feed, 

Situation  Awareness 


Long-term 

memory 

Working  memory 

Store  in  Buffer 

store  relevant 

information  on 
activity 

Working  memory 

figure  out  if 
activity  is  convoy 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Compute 

figure  out  if  activity  is 
convoy 

Processing 

strategy 

expectations  of  a 
convoy  activity 

Computational  Aid, 
Time  Constraints, 
Expertise 

Working  memory 

Count 

keep  track  of  number 
of  individual's 
performing  activity 

Sustained 

attention 

expectations  of  a 
convoy  activity 

Number  of 

Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of  a 
convoy  activity 

Working  memory 

determine 
meaning  of 
activity  observed 

Expectations, 

Expertise 

Processing 

strategy 

Interpret 

determine  meaning  of 
activity  observed 

Long-term 

memory 

define  and  name 
activity  as  convoy 

Expertise, 

Knowledge,  Number 
of  Cues 

Sustained 

attention 
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Categorize 

define  and  name 

Long-term 

inspect  convoy 

Expertise, 

activity  as  convoy 

memory 

activity 

Knowledge,  Number 
of  Cues,  Quality  of 
Feed,  Expectations 

Perceptual 

communicate 

sensitivity 

with  customer 

Adapt/Learn 

responses  to  certain 

Long-term 

confirming 

Expertise, 

activity 

memory 

convoy  activity 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

reason  to 

communicate 

Goal  Image 

inspect  convoy  activity 

Long-term 

further  scanning 

Quality  of  Feed, 

memory 

for  inspection  of 

Salience,  Visibility, 

convoy  activity  Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


communicate  with 

Processing 

customer 

strategy 

Scanning/Check  Terrain 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of 

terrain  cues 

attention 

activity  in  watch 

Change  in  Feed, 

window 

Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed, 

activity  in  watch 

attention 

cue  requires 

Visibility,  Salience, 

window 

attention 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations 
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Detect  determining  if  cue  Perceptual  search  for  cues  Expertise, 

requires  attention  sensitivity  within  visual  data  Expectations 

Distributed 

attention 

Search  search  for  cues  within  Sustained  recognize  and  Salience,  Visibility, 

visual  data  attention  label  cues  Activity  Levels, 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify  recognize  and  label  Perceptual  store  information  Expertise,  Number  of 

cues  discrimination  on  cues  Cues,  Rates  of 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 

Working  memory 

Store  in  Buffer 

store  information  on 

cues 

Working  memory 

track  number  of 

cues 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Count 

track  number  of  cues 

Sustained 

attention 

expectations  of 

cues 

Number  of 

Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of  cues 

Working  memory 

define  cues 

Expectations, 

Expertise 

Processing 

strategy 

Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  terrain  cues 

Expertise, 

Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
terrain  cues 

Long-term 

memory 

efficient  visual 
inspection  of 
terrain  cues  to 
complete  mission 

Expertise, 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

Goal  Image  efficient  visual  Long-term  further  Quality  of  Feed, 

inspection  of  terrain  memory  inspection  Salience,  Visibility, 

cues  to  complete  needed  to  Rate  of  Change, 

mission  determine  Activity  Levels, 

significance  with  Competing  Watch 
FMVfeed  Window  or  Feeds, 

Number  of  Cues, 
Expertise, 
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Expectations, 

Knowledge 


Processing 

strategy 

Scanning/Check  for  Ambush  Cues 


Cognitive 
Agent  Task 


Input 


Human 

Information 

Processing 

Resources 


Output 


Task  and 
Environmental 
Demands 


Input  Select 

pay  attention  to 
ambush  cues 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if 
cue  requires 
attention 

Quality  of  Feed, 
Visibility,  Salience, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations 

Detect 

determining  if  cue 
requires  attention 

Perceptual 

sensitivity 

search  for  cues 

within  visual  data 

Expertise, 

Expectations 

Distributed 

attention 


Search  search  for  cues  within  Sustained 
visual  data  attention 


recognize  and 
label  cues 


Salience,  Visibility, 
Activity  Levels, 
Expertise,  Number  of 
Cues 


Perceptual 

sensitivity 

Identify  recognize  and  label  Perceptual 

cues  discrimination 


store  information 
on  cues 


Expertise,  Number  of 
Cues,  Rates  of 
Change  in  Feed, 
Situation  Awareness 


Long-term 

memory 

Working  memory 

Store  in  Buffer 

store  information  on 

cues 

Working  memory 

track  number  of 

cues 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 
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Count 

track  number  of  cues 

Sustained 

expectations  of 

Number  of 

attention 

cues 

Competing  Feeds, 

Amount  of  Activity 

Working  memory 


Plan 

expectations  of  cues 

Working  memory 

define  cues 

Expectations, 

Expertise 

Processing 

strategy 

Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  ambush  cues 

Expertise, 

Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 


Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual 

Expertise, 

optimal  reaction  to 

memory 

inspection  of 

Knowledge,  Number 

ambush  cues 

ambush  cues  to 

of  Cues,  Time 

complete  mission 

Constraints 

Goal  Image  efficient  visual 

Long-term 

further 

Quality  of  Feed, 

inspection  of  ambush 

memory 

inspection 

Salience,  Visibility, 

cues  to  complete 

needed  to 

Rate  of  Change, 

mission 

determine 

Activity  Levels, 

significance  with 

Competing  Watch 

FMV  feed 

Window  or  Feeds, 

Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing 

strategy 

Scanning/Check  Traffic  Pattern 

Cognitive  Agent  Input  Human  Output  Task  and 

Task  Information  Environmental 

Processing  Demands 

Resources 

Input  Select 

pay  attention  to 
traffic  pattern  cues 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if 
cue  requires 
attention 

Quality  of  Feed, 
Visibility,  Salience, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
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Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations 

Detect 

determining  if  cue 

Perceptual 

search  for  cues 

Expertise, 

requires  attention 

sensitivity 

within  visual  data 

Expectations 

Distributed 

attention 

Search 

search  for  cues 

Sustained 

recognize  and 

Salience,  Visibility, 

within  visual  data 

attention 

label  cues 

Activity  Levels, 
Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and  label 

Perceptual 

store  information 

Expertise,  Number  of 

cues 

discrimination 

on  cues 

Cues,  Rates  of 

Change  in  Feed, 
Situation  Awareness 


Long-term 

memory 

Working  memory 

Store  in  Buffer 

store  information  on 

cues 

Working  memory 

track  number  of 

cues 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Count 

track  number  of  cues 

Sustained 

attention 

expectations  of 

cues 

Number  of 

Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of  cues 

Working  memory 

define  cues 

Expectations, 

Expertise 

Processing 

strategy 

Categorize 

define  cues 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  traffic  pattern 

cues 

Expertise, 

Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
traffic  pattern  cues 

Long-term 

memory 

efficient  visual 
inspection  of 
traffic  pattern 
cues  to  complete 
mission 

Expertise, 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

Goal  Image  efficient  visual  Long-term  further  Quality  of  Feed, 

inspection  of  traffic  memory  inspection  Salience,  Visibility, 
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pattern  cues  to 

needed  to 

Rate  of  Change, 

complete  mission 

determine 

Activity  Levels, 

significance  with 

Competing  Watch 

FMV  feed 

Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 

Scanning/Determine  Significance 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Identify 

recognize  and  label 

Perceptual 

keep  relevant 

Expertise,  Number  of 

convoy  activity 

discrimination 

actions  saved 

Cues,  Rates  of 

under  inspection  in 

Change  in  Feed, 

FMV 

Situation  Awareness 

Long-term 

memory 

Working  memory 

Store  in  Buffer 

keep  relevant 

Working  memory 

figure  out  if 

Computational  Aid, 

actions  saved 

activity  is 
significant 

Time  Constraints 

Processing 

figure  out  if 

strategy 

activity  is  non¬ 
significant 

Compute 

figure  out  if  activity 

Processing 

track  people 

Computational  Aid, 

is  significant 

strategy 

performing 

Time  Constraints, 

activity 

Expertise 

figure  out  if  activity 
is  non-significant 

Working  memory 

Count 

track  people  under 

Sustained 

people 

Number  of 

inspection 

attention 

performing 

Competing  Feeds, 

normal  or 
abnormal  activity 

Amount  of  Activity 

Working  memory 

Decide/Select 

normal  or  abnormal 

Long-term 

continue  to 

Number  of 

actions 

memory 

match  to  normal 

Competing  Feeds, 

observed 

Amount  of  Activity, 

behavior 

Expertise,  Visibility, 
Quality  of  Feed,  Rate 
of  Change, 

Expectations 
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Processing 

strategy 

continue  to 

match  to 

abnormal 

observed 

behavior 

Plan 

match  to  normal 

observed  activities 

Working  memory 

test  current 
behavior  being 
observed  to 

normal 

Expectations, 

Expertise 

match  to  abnormal 

observed  activities 

Processing 

strategy 

test  current 
behavior  being 
observed  to 

abnormal 

Test 

test  activity  being 
performed  to 
knowledge  of  a 
normal  activity 

Perceptual 

sensitivity 

potential  need 
for  further 
investigation 

Knowledge,  Expertise 

test  activity  being 
performed  to 
knowledge  of  an 
abnormal  activity 

Working  memory 

Long-term 

memory 

Interpret 

potential  need  for 
further  investigation 
based  on 
interpretation 

Long-term 

memory 

reason  for  action 

Expertise, 

Knowledge,  Number 
of  Cues 

Sustained 

attention 

Categorize 

reason  for  action 

Long-term 

memory 

efficient  visual 
inspection  of 
actions  to 
complete  mission 

Expertise, 

Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
actions  performed 

Long-term 

memory 

efficient 
significance  of 
activity 

determined  to 
complete  mission 

Expertise, 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

Goal  Image 

efficient  significance 
of  activity 
determined  to 
complete  mission 

Long-term 

memory 

determined 

significant 

Quality  of  Feed, 
Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
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Expertise, 

Expectations, 

Knowledge 

Processing 

determined  non- 

strategy 

significant 

document  for 
final  product 
report 

Scanning/Search  for  Movement 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of 

movement 

attention 

activity  in  watch 

Change  in  Feed, 

window 

Visibility,  Activity 
Levels,  Expertise 

Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed, 

activity  in  watch 

attention 

cue  requires 

Visibility,  Salience, 

window 

attention 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations 

Detect 

determining  if  cue 

Perceptual 

search  for 

Expertise, 

requires  attention 

sensitivity 

movement 

within  visual  data 

Expectations 

Distributed 

attention 

Search 

search  for 

Sustained 

recognize  and 

Salience,  Visibility, 

movement  within 

attention 

label  movement 

Activity  Levels, 

visual  data 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and  label 

Perceptual 

store  information 

Expertise,  Number  of 

movement 

discrimination 

on  movement 

Cues,  Rates  of 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 
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Working  memory 

Store  in  Buffer 

store  information 

on  movement 

Working  memory 

track  number  of 

movement 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Count 

track  number  of 

movement 

Sustained 

attention 

expectations  of 
movement 

Number  of 

Competing  Feeds, 
Amount  of  Activity 

Working  memory 

Plan 

expectations  of 
movement 

Working  memory 

define 

movement 

Expectations, 

Expertise 

Processing 

strategy 

Categorize 

define  movement 

Long-term 

memory 

appropriate  and 
optimal  reaction 
to  traffic  pattern 
movement 

Expertise, 

Knowledge,  Number 
of  Cues 

Perceptual 

sensitivity 


Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual 

Expertise, 

optimal  reaction  to 

memory 

inspection  of 

Knowledge,  Number 

movement 

movement  to 

of  Cues,  Time 

complete  mission 

Constraints 

Goal  Image  efficient  visual 

Long-term 

further 

Quality  of  Feed, 

inspection  of 

memory 

inspection 

Salience,  Visibility, 

movement  to 

needed  to 

Rate  of  Change, 

complete  mission 

determine 

Activity  Levels, 

significance  with 

Competing  Watch 

FMV  feed 

Window  or  Feeds, 

Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing 

strategy 

Scanning/  Use  Google  Earth  of  Buckeye  to  Compar3 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 
visual  feed 

Selective 

attention 

filter  out  rest  of 
possible  visual 
distractions 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 
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sensitivity 

Filter 

filter  out  rest  of 
possible  visual 
distractions 

Selective 

attention 

perform 

comparison 

Quality  of  Feed, 
Visibility,  Salience, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations 

Detect  use  Google  Eath  to  Perceptual  search  for  Expertise, 

compare  sensitivity  comparisons/cues  Expectations 

use  Buckeye  to 
compare 

Distributed 

attention 

Search 

search  for 
comparisons/cues 

Sustained 

attention 

recognize  and 
label  relevant 
comparison 
information 

Salience,  Visibility, 
Activity  Levels, 
Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify  recognize  and  label  Perceptual  view  Google  Expertise,  Number  of 

relevant  comparison  discrimination  Earth  Cues,  Rates  of 

information  Change  in  Feed, 

Situation  Awareness 

Long-term 

memory 

view  Buckeye 

Working  memory 

Message 

view  Google  Earth 

Response 

precision 

processing  using 
Google  Earth 

Expertise, 

Knowledge,  Quality 
of  Oral 

Communication, 
Quality  of  Chat  Room 

view  Buckeye  processing  using 

Buckeye 

Queue  to 
Channel 

processing  using 
Google  Earth 

Working  memory 

translating 

Google  Earth  cues 

Time  Constraints, 
Computational  aid, 
Activity  Levels, 
Expertise, 

Knowledge, 

Vigilance,  Situation 

Awareness, 

Expectations 

processing  using  Processing  translating 

Buckeye  strategy  Buckeye  cues 
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Code 

translating  Google 

Response 

saving  Google 

Computational  Aid, 

Earth  cues 

precision 

Earth  cues 

Expertise, 

Knowledge, 

Expectations 

translating  Buckeye 

Working  memory 

saving  Buckeye 

cues 

cues 

Long-term 

memory 

Store  in  Buffer 

saving  Google  Earth 

Working  memory 

compare  images 

Computational  Aid, 

cues 

based  on  selected 

Time  Constraints 

program 

saving  Buckeye  cues 

Processing 

strategy 

Decide/Select 

compare  images 

Long-term 

response  to 

Number  of 

based  on  selected 

memory 

which  cue  to  use 

Competing  Feeds, 

program 

in  visual 

Amount  of  Activity, 

inspection 

Expertise,  Visibility, 
Quality  of  Feed,  Rate 
of  Change, 

Expectations 

Processing 

strategy 

Adapt/Learn 

response  to  which 

Long-term 

efficient  visual 

Expertise, 

cue  to  use  in  visual 

memory 

comparison  to 

Knowledge,  Number 

inspection 

complete  mission 

of  Cues,  Time 
Constraints 

using  all 
resources  to 
accurately 
compare  data 

Goal  Image 

efficient  visual 

Long-term 

perform 

Quality  of  Feed, 

comparison  to 

memory 

comparison  of 

Salience,  Visibility, 

complete  mission 

data  for 

Rate  of  Change, 

successful 

Activity  Levels, 

mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

using  all  resources 

Processing 

to  accurately 
compare  data 

strategy 
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B.4  Patterns  of  Life  OFM-COG  Table 


Monitor  Chat  Rooms/  Communication 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

hit  requires 

Salience,  Rate  of 

potential  hits  or  hits 

Attention 

written  or  verbal 

Change  in  Feed, 

discovered  by  other 

communication 

Visibility,  Activity 

analysts 

(through  chat 

Levels,  Expertise 

room  or 

TeamSpeak)  to 
confirm 

visually  pay 

Perceptual 

attention  to  chat 

rooms  instead  of 

video  feed 

Sensitivity 

pay  attention  to 
confirming  hit  and 
next  steps  needed 

Detect 

hit  requires  written 

Perceptual 

recognize  and 

Expertise, 

or  verbal 

Sensitivity 

label  possible  hit 

Expectations, 

communication 

Salience,  Rate  of 

(through  chat  room 
or  TeamSpeak)  to 
confirm 

Change  in  Feed 

Distributed 

Attention 

Identify 

recognize  and  label 

Perceptual 

written  or  verbal 

Expertise,  Number  of 

possible  hit 

Discrimination 

communication 

Cues,  Rates  of 

(through  chat 

Change  in  Feed, 

room  or 

Situation  Awareness, 

TeamSpeak) 

Time  Constraints 

Long-term 

Memory 

Working  Memory 

Message 

written  or  verbal 

Response 

requires 

Expertise, 

communication 

Precision 

communication 

Knowledge,  Quality 

(through  chat  room 

to  confirm  hit 

of  Oral 

or  TeamSpeak) 

then  visual 

Communication, 

inspection 

Quality  of  Chat  Room 

Queue  to 

requires 

Working  Memory 

determine  form 

Time  Constraints, 

Channel 

communication  to 

of 

Computational  aid, 

confirm  hit  then 

communication 

Activity  Levels, 

visual  inspection 

needed  (written 

Expertise, 

or  verbal) 

Knowledge,  Vigilance, 
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Situation  Awareness, 
Expectations 


Processing 

Strategy 

Code 

determine  form  of 

Response 

communicating 

Aid,  Expertise, 

communication 

Precision 

in  correct  format 

Knowledge, 

needed  (written  or 

to  appropriate 

Expectations 

verbal) 

correspondent(s) 

Working  Memory 

Long-term 

Memory 

Transmit 

communicating  in 

Response 

keep  hit  until 

Quality  of 

correct  format  to 

Precision 

confirmed 

Communication  Feed, 

appropriate 

Physical  Action,  Time 

correspondent(s) 

Constraints,  Display 
Representation, 
Competing 
Transmissions, 
Expertise,  Knowledge 

Store  in  Buffer 

keep  hit  until 

Working  Memory 

figuring  out  if  hit 

Time  Constraints, 

confirmed 

is  confirmed 

Activity  Levels 

Processing 

Strategy 

Compute 

figuring  out  if  hit  is 

Processing 

written  or  verbal 

Computational  Aid, 

confirmed 
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understood  by  recipient 

Expertise, 

Knowledge, 

Expectations 

Selective 

attention 

Display 

create  an 

accurate 

message  that  can 
be  understood  by 
recipient 

Response 

precision 

communicate  with 
recipient 

Expertise, 

Knowledge,  Quality 
of  Communication 
Feed,  Competing 
Transmissions 

Decide/Select 

communicate 
with  recipient 

Long-term 

memory 

response  to  relevant 
historical  data 

Number  of 

Competing  Feeds, 
Amount  of  Activity, 
Expertise,  Visibility, 
Quality  of  Feed,  Rate 
of  Change, 

Expectations 

Processing 

strategy 

Adapt/Learn 

response  to 
relevant 

historical  data 

Long-term 

memory 

efficient  determination  of 
historical  data  relevancy 
to  complete  mission 

Expertise, 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

efficient  determination  of 
starting  point  for  scanning 
to  complete  mission 

Goal  Image 

efficient 

determination  of 

historical  data 
relevancy  to 
complete  mission 

Long-term 

memory 

communication  with 
recipient 

Quality  of  Feed, 
Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

efficient  Processing 

determination  of  strategy 
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starting  point  for 
scanning  to 
complete  mission 


Patterns  of  Life/  Cultural  Norms 

Religious  Norm 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity  in 

Salience,  Rate  of 

cultural  norms  in 

attention 

watch  window 

Change  in  Feed, 

visual  data  feed 

Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 

Perceptual 

religious  activity 
in  visual  data 

feed 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if  religious 

Quality  of  Feed, 

activity  in  watch 

attention 

activity  requires  attention 

Visibility,  Salience, 

window 

Visibility,  Rate  of 
Change,  Activity 

Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determining  if 

Perceptual 

search  for  religious  norms 

Expertise, 

religious  activity 

requires 

attention 

sensitivity 

within  visual  data 

Expectations 

Distributed 

attention 

Search 

search  for 

Sustained 

recognize  and  label 

Salience,  Visibility, 

religious  norms 

attention 

religious  activity 

Activity  Levels, 

within  visual  data 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information  on 

Expertise,  Number  of 

label  religious 

discriminatio 

current  religious  actions 

Cues,  Rates  of 

activity 

n 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 

Working 

memory 
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Store  in 

store  information 

Working 

figure  out  if  activity  is  a 

Computational  Aid, 

Buffer 

on  current 
religious  actions 

memory 

religious  norm 

Time  Constraints 

Processing 

strategy 


Compute 

figure  out  if 

Processing 

tracking  people 

Computational  Aid, 

activity  is  a 

strategy 

performing  religious 

Time  Constraints, 

religious  norm 

activity 

Expertise 

Working 

memory 


Count 

tracking  people 

Sustained 

expectations  of  religious 

Number  of 

performing 

attention 

activity 

Competing  Feeds, 

religious  activity 

Amount  of  Activity 

Working 

memory 


Plan 

expectations  of 

Working 

determine  meaning 

Expectations, 

religious  activity 

memory 

behind  religious  activity 
pattern 

Expertise 

Processing 

strategy 


Interpret 

determine 

Long-term 

define  religious  activity 

Expertise, 

meaning  behind 

memory 

Knowledge,  Number 

religious  activity 
pattern 

of  Cues 

Sustained 

attention 


Categorize 

define  religious 

Long-term 

appropriate  and  optimal 

Expertise, 

activity 

memory 

reaction  to  religious 

Knowledge,  Number 

activity 

of  Cues 

Perceptual 

sensitivity 


Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual  inspection 

Expertise, 

optimal  reaction 

memory 

of  religious  activity  to 

Knowledge,  Number 

to  religious 

complete  mission 

of  Cues,  Time 

activity 

Constraints 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  needed 

Quality  of  Feed, 

inspection  of 

memory 

to  determine  significance 

Salience,  Visibility, 

religious  activity 

of  religious  activity  within 

Rate  of  Change, 

to  complete 

visual  data  feed 

Activity  Levels, 

mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 
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Patterns  of  Life/  Times  for  Prayer 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Search 

prayer  activities 

Sustained 

recognize  and  label 

Salience,  Visibility, 

attention 

actions  as  prayer  related 

Activity  Levels, 
Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

recognize  and  label  timing 

Identify 

recognize  and 

Perceptual 

keep  relevant  prayer 

Expertise,  Number  of 

label  actions  as 

discriminatio 

related  actions  saved 

Cues,  Rates  of 

prayer  related 

n 

Change  in  Feed, 
Situation  Awareness 

recognize  and 

Long-term 

keep  timing  of  prayer 

label  timing 

memory 

activities  saved 

Working 

memory 

Store  in 

keep  relevant 

Working 

deviation  between  normal 

Computational  Aid, 

Buffer 

prayer  related 
actions  saved 

memory 

and  abnormal  action 

Time  Constraints 

keep  timing  of 

Processing 

deviation  between  normal 

prayer  activities 

strategy 

and  abnormal  timing  of 

saved 

action 

Count 

track  amount  of 

Sustained 

deviation  between  actual 

Number  of 

people 

attention 

number  of  people 

Competing  Feeds, 

performing 

accounted  for  entering 

Amount  of  Activity 

prayer  activities 

and  exiting  place  of  prayer 

Working 

memory 

Decide/Select 

normal  or 

Long-term 

match  prayer  time  to 

Number  of 

abnormal 

memory 

normal  prayer  time 

Competing  Feeds, 

behavior 

Amount  of  Activity, 
Expertise,  Visibility, 
Quality  of  Feed,  Rate 
of  Change, 

Expectations 

normal  or 

Processing 

match  prayer  time  to 

abnormal  timing 
of  behavior 

strategy 

abnormal  prayer  time 

amount  of 

match  amount  of  people 

people 

accounted  for  from  start 

accounted  for  in 

performing 

activity 

to  finish 

Plan 

match  prayer 

Working 

actual  behavior 

Expectations, 
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time  to  normal 
prayer  time 

memory 

performed 

Expertise 

match  prayer 

Processing 

actual  number  of  people 

time  to  abnormal 
prayer  time 

strategy 

accounted  for 

match  amount  of 
people 

accounted  for 

from  start  to 

finish 

Test 

actual  behavior 

Perceptual 

potential  need  for  further 

Knowledge,  Expertise 

performed 

sensitivity 

investigation 

actual  number  of 

Working 

people 

accounted  for 

memory 

Long-term 

memory 

Interpret 

potential  need 

Long-term 

reason  for  behavior 

Expertise, 

for  further 

memory 

Knowledge,  Number 

investigation 

of  Cues 

Sustained 

estimate  of  unaccounted 

attention 

for  people 

reason  for  unaccounted 
for  people 

Categorize 

reason  for 

Long-term 

efficient  visual  inspection 

Expertise, 

behavior 

memory 

of  related  prayer  activity 

Knowledge,  Number 

to  complete  mission 

of  Cues 

estimate  of 

Perceptual 

unaccounted  for 
people 

sensitivity 

reason  for 

unaccounted  for 
people 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  needed 

Quality  of  Feed, 

inspection  of 

memory 

to  determine  significance 

Salience,  Visibility, 

related  prayer 

of  activity 

Rate  of  Change, 

activity  to 

Activity  Levels, 

complete  mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

further  inspection  needed 

strategy 

to  determine  significance 
of  time 

further  inspection  needed 
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to  determine  significance 
of  unaccountable  people 
or  person 


Patterns  of  Life/  Cultural  Norms 

Attire  of  Individual 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity  in 

Salience,  Rate  of 

cultural  norms 

attention 

watch  window 

Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 

Perceptual 

attire  of 

individuals 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if  attire  of 

Quality  of  Feed, 

activity  in  watch 

attention 

individual  requires 

Visibility,  Salience, 

window 

attention 

Visibility,  Rate  of 
Change,  Activity 

Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determining  if 

Perceptual 

search  for  abnormal  attire 

Expertise, 

attire  of 

individual 

requires 

attention 

sensitivity 

within  visual  data 

Expectations 

Distributed 

attention 

Search 

search  for 

Sustained 

recognize  and  attire  of 

Salience,  Visibility, 

abnormal  attire 

attention 

individual 

Activity  Levels, 

within  visual  data 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information  on  the 

Expertise,  Number  of 

label  attire  of 

discriminatio 

attire  of  people 

Cues,  Rates  of 

individuals 

n 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 

Working 

memory 
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Store  in 

Buffer 

store  information 

on  the  attire  of 
people 

Working 

memory 

figure  out  if  attire  is 
normal 

Computational  Aid, 
Time  Constraints 

Processing 

strategy 

Compute 

figure  out  if 
attire  is  normal 

Processing 

strategy 

expectations  of  attire 

Computational  Aid, 
Time  Constraints, 
Expertise 

Working 

memory 

Plan 

expectations  of 
people's  attire 

Working 

memory 

determine  meaning 
behind  pattern  of  attire 
worn  by  people 

Expectations, 

Expertise 

Processing 

strategy 

Interpret 

determine 
meaning  behind 
pattern  of  attire 
worn  by 
individuals 

Long-term 

memory 

define  normal  behavior 

based  on  attire 

Expertise, 

Knowledge,  Number 
of  Cues 

Sustained  define  abnormal  behavior 

attention  based  on  attire 

Categorize 

define  normal 

attire 

Long-term 

memory 

appropriate  and  optimal 
reaction  to  attire 

Expertise, 

Knowledge,  Number 
of  Cues 

define  abnormal  Perceptual 
attire  sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction 
to  individual's 

attire 

Long-term 

memory 

efficient  visual  inspection 
of  attire  to  complete 
mission 

Expertise, 

Knowledge,  Number 
of  Cues,  Time 
Constraints 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  needed 

Quality  of  Feed, 

inspection  of 

memory 

to  determine  significance 

Salience,  Visibility, 

individual's  attire 

of  an  individual's  attire 

Rate  of  Change, 

to  complete 

within  visual  feed 

Activity  Levels, 

mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 
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Patterns  of  Life/  Cultural  Norms 

Female  Walks  Behind  Male 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity  in 

Salience,  Rate  of 

cultural  norms 

attention 

watch  window 

Change  in  Feed, 

in  visual  data 

Visibility,  Activity 

feed 

Levels,  Expertise 

pay  attention  to 

Perceptual 

discriminations 
in  gender  within 
visual  data  feed 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if  gender 

Quality  of  Feed, 

activity  in  watch 

attention 

roles  requires  attention 

Visibility,  Salience, 

window 

Visibility,  Rate  of 
Change,  Activity 

Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determining  if 

Perceptual 

search  for  abnormal 

Expertise, 

gender  roles 

sensitivity 

gender  roles  are 

Expectations 

requires 

prominent  within  visual 

attention 

data 

Distributed 

attention 

Search 

search  for 

Sustained 

recognize  and  label 

Salience,  Visibility, 

abnormal 

attention 

gender 

Activity  Levels, 

gender  roles  are 

Expertise,  Number  of 

prominent 
within  visual 

data 

Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information  on  the 

Expertise,  Number  of 

label  gender 

discriminatio 

gender  of  individual's  for 

Cues,  Rates  of 

n 

later  use 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in  Buffer 

store 

Working 

figure  out  if  gender  role  is 

Computational  Aid, 

information  on 

memory 

normal 

Time  Constraints 
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the  gender  of 
individual's  for 

later  use 

Processing 

strategy 

Compute 

figure  out  if 

Processing 

tracking  people  based  on 

Computational  Aid, 

gender  role  is 

strategy 

gender 

Time  Constraints, 

normal 

Expertise 

Working 

memory 

Count 

tracking  people 

Sustained 

expectations  of  gender 

Number  of 

based  on  gender 

attention 

Competing  Feeds, 
Amount  of  Activity 

Working 

memory 

Plan 

expectations  of 

Working 

determine  meaning 

Expectations, 

gender 

memory 

behind  pattern  of  gender 
actions 

Expertise 

Processing 

strategy 

Interpret 

determine 

Long-term 

define  normal  behavior 

Expertise, 

meaning  behind 

memory 

based  on  gender 

Knowledge,  Number 

pattern  of 
gender  actions 

of  Cues 

Sustained 

define  abnormal  behavior 

attention 

based  on  gender 

Categorize 

define  normal 

Long-term 

appropriate  and  optimal 

Expertise, 

behavior  based 

memory 

reaction  to  gender 

Knowledge,  Number 

on  gender 

of  Cues 

define  abnormal 

Perceptual 

behavior  based 
on  gender 

sensitivity 

Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual  inspection 

Expertise, 

optimal  reaction 

memory 

of  gender  roles  to 

Knowledge,  Number 

to  gender 

complete  mission 

of  Cues,  Time 
Constraints 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  needed 

Quality  of  Feed, 

inspection  of 

memory 

to  determine  significance 

Salience,  Visibility, 

gender  roles  to 

of  gender  within  visual 

Rate  of  Change, 

complete 

feed 

Activity  Levels, 

mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 
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strategy 


Patterns  of  Life/  Examine  Body  Language 

Cognitive  Input  Human  Output  Task  and 

Agent  Task  Information  Environmental 

Processing  Demands 

Resources 

Search 

look  for  individual's 
under  inspection 

Sustained 

attention 

recognize  and  label 
the  individual(s) 

Salience,  Visibility, 
Activity  Levels, 
Expertise, 

Number  of  Cues 

Perceptual  recognize  and  label 

sensitivity  the  individual(s)  body 

language 

recognize  and  label 
the  individual(s)'s 
activity 

Identify  recognize  and  label  the  Perceptual  keep  relevant  actions  Expertise, 

individual(s)  discrimination  saved  Number  of  Cues, 

Rates  of  Change 
in  Feed,  Situation 
Awareness 

recognize  and  label  the 
individual(s)'s  body 
language 

Long-term 

memory 

recognize  and  label  the  Working 
individual(s)'s  activity  memory 

Store  in 

Buffer 

keep  relevant  actions 
saved 

Working 

memory 

track  amount  of 
people  under 
inspection 

Computational 

Aid,  Time 
Constraints 

Processing 

strategy 

Count 

track  amount  of  people 
under  inspection 

Sustained 

attention 

normal  or  abnormal 
body  language 

Number  of 
Competing  Feeds, 
Amount  of 

Activity 

Working 

memory 

Decide/Select 

normal  or  abnormal 
body  language 

Long-term 

memory 

match  to  normal 

observed  behavior 

Number  of 
Competing  Feeds, 
Amount  of 

Activity,  Expertise, 
Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 
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Processing  match  to  abnormal 

strategy  observed  behavior 

Plan 

match  to  normal 
observed  body  language 

Working 

memory 

test  actual  behavior 
being  observed  to 
normal 

Expectations, 

Expertise 

match  to  abnormal  Processing  test  actual  behavior 

observed  body  language  strategy  being  observed  to 

abnormal 

Test 

test  body  language 
being  observed  to 
normal 

Perceptual 

sensitivity 

potential  need  for 
further  investigation 

Knowledge, 

Expertise 

test  body  language  Working 

being  observed  to  memory 

abnormal 

Long-term 

memory 

Interpret  potential  need  for  Long-term  reason  for  body  Expertise, 

further  investigation  memory  language  Knowledge, 

based  on  body  language  Number  of  Cues 

Sustained 

attention 

Categorize 

reason  for  body 
language 

Long-term 

memory 

efficient  visual 
inspection  of  body 
language  to  complete 
mission 

Expertise, 

Knowledge, 

Number  of  Cues 

Perceptual 

sensitivity 

Goal  Image 

efficient  visual 
inspection  of  body 
language  to  complete 
mission 

Long-term 

memory 

further  inspection 
needed  to  determine 
significance  of  body 
language 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

Processing  continue  scanning  if 

strategy  body  language  normal 

Patterns  of  Life/Significance  of  Cultural  Norm 

Cognitive  Input  Human 

Agent  Task  Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 
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Identify 

recognize  and  label 

Perceptual 

keep  relevant  actions 

Expertise,  Number 

cultural  norm  under 

discriminati 

saved 

of  Cues,  Rates  of 

inspection  as  suspicious 

on 

Change  in  Feed, 

behavior 

Situation 

Awareness 

recognize  and  label 

Long-term 

store  information  on 

abnormal  timing  of 

memory 

current  cultural  norms 

cultural  events 

for  selected  AOI 

Working 

memory 

Store  in  Buffer 

keep  relevant  actions 

Working 

figure  out  if  activity  is  a 

Computational 

saved 

memory 

cultural  norm 

Aid,  Time 
Constraints 

store  information  on 

Processing 

current  cultural  norms 

for  selected  AOI 

strategy 

Compute 

figure  out  if  activity  is  a 

Processing 

track  people 

Computational 

cultural  norm 

strategy 

performing  cultural 

Aid,  Time 

activity 

Constraints, 

Expertise 

Working 

memory 

Count 

track  people  under 

Sustained 

people  performing 

Number  of 

inspection 

attention 

normal  or  abnormal 

Competing  Feeds, 

activity 

Amount  of 

Activity 

Working 

memory 

Decide/Select 

normal  or  abnormal 

Long-term 

continue  to  match  to 

Number  of 

actions 

memory 

normal  observed 

Competing  Feeds, 

behavior 

Amount  of 

Activity,  Expertise, 
Visibility,  Quality 
of  Feed,  Rate  of 
Change, 
Expectations 

Processing 

continue  to  match  to 

strategy 

abnormal  observed 

behavior 

Plan 

match  to  normal 

Working 

test  current  behavior 

Expectations, 

observed  activities 

memory 

being  observed  to 
normal 

Expertise 

match  to  abnormal 

Processing 

test  current  behavior 

observed  activities 

strategy 

being  observed  to 
abnormal 

Test 

test  activity  being 

Perceptual 

potential  need  for 

Knowledge, 

performed  to 

sensitivity 

further  investigation 

Expertise 
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knowledge  of  a  normal 
activity 

test  activity  being 

Working 

performed  to 
knowledge  of  an 
abnormal  activity 

memory 

Long-term 

memory 

Interpret 

potential  need  for 

Long-term 

reason  for  action 

Expertise, 

further  investigation 

memory 

Knowledge, 

based  on  interpretation 

Number  of  Cues 

Sustained 

attention 

Categorize 

reason  for  action 

Long-term 

efficient  visual 

Expertise, 

memory 

inspection  of  actions  to 

Knowledge, 

complete  mission 

Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and  optimal 

Long-term 

efficient  visual 

Expertise, 

reaction  to  cultural 

memory 

inspection  of  cultural 

Knowledge, 

actions  performed 

activity  to  complete 

Number  of  Cues, 

mission 

Time  Constraints 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  with 

Quality  of  Feed, 

inspection  of  cultural 

memory 

FMV 

Salience,  Visibility, 

activities  to  complete 

Rate  of  Change, 

mission 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

Processing 

further  inspection  with 

strategy 

WAMI 

stop  inspection  of 
current  cultural  norm 
and  continue  scanning 
for  other  patterns  of 
life  activities 

Patterns  of  Life/  Ignore  Cultural  Norms 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Identify 

recognize  and 
label  normal 

Perceptual 

discrimination 

dispose  information  on 
inspected  cultural  activity 

Expertise,  Number  of 
Cues,  Rates  of 
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behavior  of 
cultural  activity 

Change  in  Feed, 
Situation  Awareness 

recognize  and  Long-term 

label  normal  memory 

timing  of  cultural 
events 

recognize  and 
label  cultural 
activity  as  non¬ 
significant  based 
on  pattern  of  life 

Working 

memory 

Purge 

dispose 

Selective 

ignore  past  activity 

Expertise 

information  on 
inspected 
cultural  activity 

attention 

observed 

Decide/Select 

ignore  past 

Long-term 

begin  new  scan 

Number  of 

activity  observed 

memory 

Competing  Feeds, 
Amount  of  Activity, 
Expertise,  Visibility, 
Quality  of  Feed,  Rate 
of  Change, 

Expectations 

Processing 

strategy 

Control 

begin  new  scan 

Response 

need  for  further 

Expertise, 

Precision 

investigation  of  other 

Knowledge,  Number 

cultural  activities  within 

of  Cues,  Time 

watch  window 

Constraints 

Interpret 

need  for  further 

Long-term 

thorough  inspection  of  all 

Expertise, 

investigation  of 

memory 

cultural  norms  to 

Knowledge,  Number 

other  cultural 

activities  within 

watch  window 

complete  mission 

of  Cues 

Sustained 

attention 

Goal  Image 

thorough 

Long-term 

make  judgment  on 

Quality  of  Feed, 

inspection  of  all 

memory 

cultural  norms  to 

Salience,  Visibility, 

cultural  norms  to 

complete  mission 

Rate  of  Change, 

complete  mission 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 
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Patterns  of  Life/  Presence  of  Children 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity 

Salience,  Rate  of 

cultural  norms  in 

attention 

in  watch  window 

Change  in  Feed, 

visual  data  feed 

Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 

Perceptual 

discriminations  in 
age  within  visual 
data  feed 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determining  if  age  of 

Quality  of  Feed, 

activity  in  watch 

attention 

individual(s)  requires 

Visibility,  Salience, 

window 

attention 

Visibility,  Rate  of 
Change,  Activity 

Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 

Cues,  Expertise, 
Expectations 

Detect 

determining  if  age 

Perceptual 

search  for  indicators  of 

Expertise, 

of  individual(s) 
requires  attention 

sensitivity 

age  of  individual(s) 

Expectations 

Distributed 

attention 

Search 

search  for 

Sustained 

recognize  and  label 

Salience,  Visibility, 

indicators  of  age 

attention 

individual(s)  as  child(ren) 

Activity  Levels, 

of  individual(s) 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  information  on  the 

Expertise,  Number  of 

label  individual(s) 

discrimination 

age  of  the  individual(s) 

Cues,  Rates  of 

as  child(ren) 

for  later  use 

Change  in  Feed, 
Situation  Awareness 

Long-term 

memory 

Working 

memory 

Store  in 

store  information 

Working 

figure  out  if  age  of 

Computational  Aid, 

Buffer 

on  the  age  of  the 
individual(s)  for 
later  use 

memory 

individual(s)  is  correct 

Time  Constraints 

Processing 

strategy 
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Compute 

figure  out  if  age  of 

Processing 

tracking  people  based  on 

Computational  Aid, 

individual(s)  is 

strategy 

age 

Time  Constraints, 

correct 

Expertise 

Working 

memory 


Count 

tracking  people 

Sustained 

expectations  of  child(ren) 

Number  of 

based  on  age 

attention 

Competing  Feeds, 

Amount  of  Activity 

Working 

memory 


Plan 

expectations  of 

Working 

determine  meaning 

Expectations, 

child(ren) 

memory 

behind  actions  of 
child(ren) 

Expertise 

Processing 

strategy 


Interpret 

determine 

Long-term 

define  normal  behavior 

Expertise, 

meaning  behind 

memory 

based  on  age 

Knowledge,  Number 

actions  of 
child(ren) 

of  Cues 

Sustained 

attention 

define  abnormal 
behavior  based  on  age 

Categorize 

define  normal 

Long-term 

appropriate  and  optimal 

Expertise, 

behavior  based  on 

memory 

reaction  to  age 

Knowledge,  Number 

age 

of  Cues 

define  abnormal 

Perceptual 

behavior  based  on 

sensitivity 

age 

Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual  inspection 

Expertise, 

optimal  reaction 

memory 

of  age  discrimination  to 

Knowledge,  Number 

to  age 

complete  mission 

of  Cues,  Time 

Constraints 

Goal  Image 

efficient  visual 

Long-term 

further  inspection 

Quality  of  Feed, 

inspection  of  age 

memory 

needed  to  determine 

Salience,  Visibility, 

discrimination  to 

significance  of  child(ren) 

Rate  of  Change, 

complete  mission 

within  visual  feed 

Activity  Levels, 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing 

strategy 
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Patterns  of  Life/  Significance  of  Child's  Presence 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Identify 

recognize  and 

Perceptual 

keep  relevant  actions  of 

Expertise,  Number  of 

label  size  of 

discrimination 

chi Id(ren)  saved 

Cues,  Rates  of 

individual 

Change  in  Feed, 
Situation  Awareness 

recognize  and 

Long-term 

label  activity  of 
individual 

memory 

recognize  and 

Working 

label  placement 
of  individual  in 

memory 

group 

Store  in  Buffer 

keep  relevant 

Working 

figure  out  if  activity  for 

Computational  Aid, 

actions  of 
child(ren)  saved 

memory 

chi Id(ren)  is  normal 

Time  Constraints 

Processing 

strategy 

Compute 

figure  out  if 

Processing 

track  child(ren) 

Computational  Aid, 

activity  for 

strategy 

Time  Constraints, 

chi Id(ren)  is 
normal 

Expertise 

Working 

memory 

Count 

track  child(ren) 

Sustained 

child(ren)  performing 

Number  of 

attention 

normal  or  abnormal 

Competing  Feeds, 

activity 

Amount  of  Activity 

Working 

memory 

Decide/Select 

normal  or 

Long-term 

match  to  normal 

Number  of 

abnormal  actions 

memory 

observed  behavior 

Competing  Feeds, 
Amount  of  Activity, 
Expertise,  Visibility, 
Quality  of  Feed,  Rate 
of  Change, 

Expectations 

Processing 

match  to  abnormal 

strategy 

observed  behavior 

Plan 

match  to  normal 

Working 

test  current  behavior 

Expectations, 

observed 

activities 

memory 

being  observed  to  normal 

Expertise 

match  to 

Processing 

test  current  behavior 

abnormal 

strategy 

being  observed  to 

observed 

abnormal 
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activities 

Test 

test  activity  being 

Perceptual 

potential  need  for 

Knowledge,  Expertise 

performed  by 
child(ren)  to 
knowledge  of  a 
normal  activity 

sensitivity 

further  investigation 

test  activity  being 

Working 

performed  by 
child(ren)  to 
knowledge  of  an 
abnormal  activity 

memory 

Long-term 

memory 

Interpret 

potential  need 

Long-term 

reason  for  action 

Expertise, 

for  further 

memory 

Knowledge,  Number 

investigation 
based  on 
interpretation 

of  Cues 

Sustained 

attention 

Categorize 

reason  for  action 

Long-term 

efficient  visual  inspection 

Expertise, 

memory 

of  actions  to  complete 

Knowledge,  Number 

mission 

of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual  inspection 

Expertise, 

optimal  reaction 

memory 

of  child(ren)  activity  to 

Knowledge,  Number 

to  chi Id(ren) 

complete  mission 

of  Cues,  Time 

actions 

performed 

Constraints 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  with 

Quality  of  Feed, 

inspection  of 

memory 

FMV 

Salience,  Visibility, 

child(ren) 

Rate  of  Change, 

activities  to 

Activity  Levels, 

complete  mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

further  inspection  with 

strategy 

WAMI 

stop  inspection  of 
current  cultural  norm 
and  continue  scanning 
for  other  patterns  of  life 
activities 
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Patterns  of  Life/Local  Norms 

Market  Times 

Cognitive 

Input 

Human 

Output 

Task  and  Environmental 

Agent  Task 

Information 

Demands 

Processing 

Resources 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of 

Salience,  Rate  of  Change 

local  norms  in 

attention 

activity  in  watch 

in  Feed,  Visibility, 

visual  data  feed 

window 

Activity  Levels,  Expertise 

pay  attention  to 

Perceptual 

market  activity  in 
visual  data  feed 

sensitivity 

pay  attention  to 
timing  of  market 
activity  in  visual 
data  feed 

Filter 

filter  out  rest  of 

Selective 

determining  if 

Quality  of  Feed, 

activity  in  watch 

attention 

market  activity 

Visibility,  Salience, 

window 

requires  attention 

Visibility,  Rate  of 

Change,  Activity  Levels, 
Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations 

determining  if  timing 
of  market  activity 
requires  attention 

Detect 

determining  if 

Perceptual 

search  for  market 

Expertise,  Expectations 

market  activity 

sensitivity 

activity  within  visual 

requires  attention 

data 

determining  if 

Distributed 

timing  of  market 
activity  requires 
attention 

attention 

Search 

search  for  market 

Sustained 

recognize  and  label 

Salience,  Visibility, 

activity  within 

attention 

market  activity 

Activity  Levels, 

visual  data 

Expertise,  Number  of 

Cues 

Perceptual 

recognize  and  label 

sensitivity 

timing  of  market 
activity 

Identify 

recognize  and  label 

Perceptual 

store  information  on 

Expertise,  Number  of 

market  activity 

discrimination 

current  market 

Cues,  Rates  of  Change  in 

activities 

Feed,  Situation 

Awareness 

recognize  and  label 

Long-term 

store  information  on 

200 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


timing  of  market 

memory 

timing  of  market 

activity 

activities  (pins  used 

for  this) 

Working 

memory 


Store  in 

store  information 

Working 

figure  out  if  activity 

Computational  Aid,  Time 

Buffer 

on  current  market 

activities 

memory 

is  normal 

Constraints 

store  information  Processing  figure  out  if  timing  is 

on  timing  of  strategy  normal 

market  activities 
(placed  pin) 


Compute 

figure  out  if  activity 
is  normal  for 

market 

Processing 

strategy 

tracking  people  at 
the  market 

Computational  Aid,  Time 
Constraints,  Expertise 

figure  out  if  timing 
is  normal  for 

market 

Working 

memory 

tracking  timing  of 
people  at  the  market 

Count 

tracking  people  at 
market 

Sustained 

attention 

expectations  of 
amount  of  people  at 
the  market 

Number  of  Competing 
Feeds,  Amount  of 

Activity 

tracking  timing  of 
people  at  the 
market 

Working 

memory 

expectations  of 
timing  of  people  at 
the  market 

expectations  of 
people  at  the  market 

expectations  of 

people's  actions  at 

the  market 

Plan 

expectations  of 

Working 

determine  meaning 

Expectations,  Expertise 

amount  of  people 

memory 

behind  amount  of 

at  the  market 

people 

expectations  of 

Processing 

determine  meaning 

timing  of  people  at 

strategy 

behind  timing  of 

the  market 

market 

expectations  of 

determine  meaning 

people  at  the 

of  who  attends 

market 

market 

expectations  of 

determine  meaning 

people's  actions  at 

behind  people's 

the  market 

actions 

Interpret 

determine  meaning 

Long-term 

define  market 

Expertise,  Knowledge, 

behind  amount  of 

memory 

activity 

Number  of  Cues 

people 

determine  meaning 

Sustained 

define  timing  of 

behind  timing  of 

attention 

market 

market 
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determine  meaning 
of  who  attends 

market 

categorize  people  in 
attendance 

determine  meaning 

define  people's 

behind  people's 

actions 

actions 

Categorize 

define  market 

Long-term 

appropriate  and 

Expertise,  Knowledge, 

activity 

memory 

optimal  reaction  to 

Number  of  Cues 

market  activity 

define  timing  of 

Perceptual 

appropriate  and 

market 

sensitivity 

optimal  reaction  to 

timing  of  market 

categorize  people 
in  attendance 

appropriate  and 
optimal  reaction  to 
type  of  people  in 
attendance 

define  people's  appropriate  and 

actions  optimal  reaction  to 

people's  actions  at 
market 

Adapt/Learn 

appropriate  and 
optimal  reaction  to 
market  activity 

Long-term 

memory 

efficient  visual 
inspection  of  market 
activity  to  complete 
mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

appropriate  and  efficient  visual 

optimal  reaction  to  inspection  of  market 

timing  of  market  timing  to  complete 

mission 

appropriate  and 
optimal  reaction  to 
type  of  people  in 
attendance 

appropriate  and 
optimal  reaction  to 
people's  actions  at 
market 

Goal  Image 

efficient  visual 
inspection  of 
market  activity  to 
complete  mission 

Long-term 

memory 

further  inspection 
needed  to  determine 
significance  of 
market  activity 
within  visual  data 

feed 

Quality  of  Feed, 

Salience,  Visibility,  Rate 
of  Change,  Activity 

Levels,  Competing 

Watch  Window  or 

Feeds,  Number  of  Cues, 
Expertise,  Expectations, 
Knowledge 

efficient  visual  Processing  further  inspection 

inspection  of  strategy  needed  to  determine 

market  timing  to  significance  of 
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complete  mission 

market  timing  within 

visual  data  feed 

Patterns  of  Life/  Local  Norms 

Patterns  of  Traffic 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and  Environmental 

Demands 

Input  Select 

pay  attention  to 
local  norms  in 

visual  data  feed 

Selective 

attention 

filter  out  rest  of 
activity  in  watch 
window 

Salience,  Rate  of  Change 
in  Feed,  Visibility,  Activity 
Levels,  Expertise 

pay  attention  to 
traffic  patterns  in 
visual  data  feed 

Perceptual 

sensitivity 

pay  attention  to 
timing  of  traffic 
patterns  in  visual 
data  feed 

Filter 

filter  out  rest  of 
activity  in  watch 
window 

Selective 

attention 

determining  if  traffic 
pattern  requires 
attention 

Quality  of  Feed,  Visibility, 
Salience,  Visibility,  Rate  of 
Change,  Activity  Levels, 
Competing  Watch 

Window  or  Feeds, 

Number  of  Cues, 

Expertise,  Expectations 

determining  if  timing 
of  traffic  requires 
attention 

Detect 

determining  if 
traffic  pattern 
requires  attention 

Perceptual 

sensitivity 

search  for  traffic 
patterns  within 
visual  data 

Expertise,  Expectations 

determining  if 
timing  of  traffic 
activity  requires 
attention 

Distributed 

attention 

Search 

search  for  traffic 
patterns  within 
visual  data 

Sustained 

attention 

recognize  and  label 
traffic  patterns 

Salience,  Visibility, 

Activity  Levels,  Expertise, 
Number  of  Cues 

Perceptual 

sensitivity 

recognize  and  label 
timing  of  traffic 
activity 

Identify 

recognize  and  label 
traffic  patterns 

Perceptual 

discrimination 

store  information  on 

current  traffic 
patterns 

Expertise,  Number  of 

Cues,  Rates  of  Change  in 
Feed,  Situation 

Awareness 

recognize  and  label 

Long-term 

store  information  on 
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timing  of  traffic 
activity 

memory 

timing  of  traffic 
activities 

Working 

memory 

Store  in 

Buffer 

store  information 

on  current  traffic 
patterns 

Working 

memory 

figure  out  if  activity 
is  normal 

Computational  Aid,  Time 
Constraints 

store  information  Processing  figure  out  if  timing  is 

on  timing  of  traffic  strategy  normal 

activities 


Compute 

figure  out  if  traffic 

Processing 

tracking  vehicles 

Computational  Aid,  Time 

pattern  is  normal 

strategy 

Constraints,  Expertise 

figure  out  if  timing  Working  tracking  timing  of 

is  normal  for  traffic  memory  vehicles 

pattern 


Count 

tracking  vehicles 

Sustained 

attention 

expectations  of 
amount  of  vehicles 

Number  of  Competing 
Feeds,  Amount  of  Activity 

tracking  timing  of  Working  expectations  of 

vehicles  memory  timing  of  traffic 

expectations  of  type 
of  vehicles 

expectations  of 
traffic  pattern 

Plan 

expectations  of 
amount  of  vehicles 

Working 

memory 

determine  meaning 
behind  amount  of 

vehicles 

Expectations,  Expertise 

expectations  of  Processing  determine  meaning 

timing  of  traffic  strategy  behind  timing  of 

traffic 

expectations  of 
type  of  vehicles 

determine  meaning 
of  types  of  vehicles 

expectations  of  determine  meaning 

traffic  pattern  behind  traffic 

pattern 

Interpret 

determine  meaning 
behind  amount  of 

vehicles 

Long-term 

memory 

define  amount  of 

vehicles 

Expertise,  Knowledge, 
Number  of  Cues 

determine  meaning  Sustained  define  timing  of 

behind  timing  of  attention  traffic 

traffic 

determine  meaning 
of  types  of  vehicles 

categorize  vehicles 

determine  meaning  define  traffic  pattern 

behind  traffic 

pattern 

Categorize 

define  amount  of 

vehicles 

Long-term 

memory 

appropriate  and 
optimal  reaction  to 

Expertise,  Knowledge, 
Number  of  Cues 
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amount  of  vehicles 

define  timing  of 
traffic 

Perceptual 

sensitivity 

appropriate  and 
optimal  reaction  to 
timing  of  traffic 

categorize  vehicles 

appropriate  and 

optimal  reaction  to 

type  of  vehicles 

define  traffic 

appropriate  and 

pattern 

optimal  reaction  to 

traffic  pattern 

Adapt/Learn 

appropriate  and 

Long-term 

efficient  visual 

Expertise,  Knowledge, 

optimal  reaction  to 

memory 

inspection  of  traffic 

Number  of  Cues,  Time 

amount  of  vehicles 

patterns  to  complete 

Constraints 

mission 

appropriate  and 

efficient  visual 

optimal  reaction  to 

inspection  of  traffic 

timing  of  traffic 

timing  to  complete 

mission 

appropriate  and 
optimal  reaction  to 
type  of  vehicles 

appropriate  and 
optimal  reaction  to 
traffic  pattern 


Goal  Image 

efficient  visual 

Long-term 

further  inspection 

inspection  of  traffic 

memory 

needed  to 

patterns  to 

determine 

complete  mission 

significance  of  traffic 
pattern  within  visual 
data  feed 

Quality  of  Feed,  Salience, 
Visibility,  Rate  of  Change, 
Activity  Levels,  Competing 
Watch  Window  or  Feeds, 
Number  of  Cues, 

Expertise,  Expectations, 
Knowledge 


efficient  visual 
inspection  of  traffic 
timing  to  complete 
mission 


Processing 

strategy 


further  inspection 
needed  to 
determine 

significance  of  traffic 
timing  within  visual 
data  feed 


Patterns  of  Life/  Local  Norms 

Weather  Factors 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Input  Select 

pay  attention  to 
local  norms  in 

visual  data  feed 

Selective 

attention 

filter  out  rest  of  activity  in 
watch  window 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
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Levels,  Expertise 

pay  attention  to 

Perceptual 

actions  related  to 

weather  factors 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

search  for  weather 

Quality  of  Feed, 

activity  in  watch 

attention 

related  actions  within 

Visibility,  Salience, 

window 

visual  data 

Visibility,  Rate  of 
Change,  Activity 

Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 

Cues,  Expertise, 
Expectations 

Search 

search  for  weather 

Sustained 

recognize  and  label 

Salience,  Visibility, 

related  actions 

attention 

current  weather 

Activity  Levels, 

within  visual  data 

conditions 

Expertise,  Number  of 
Cues 

Perceptual 

recognize  and  label 

sensitivity 

actions  as  weather 

related 

Identify 

recognize  and 

Perceptual 

store  information  on 

Expertise,  Number  of 

label  current 

discrimination 

current  weather 

Cues,  Rates  of  Change 

weather 

conditions 

in  Feed,  Situation 

conditions 

Awareness 

recognize  and 

Long-term 

store  information  on 

label  actions  as 

memory 

possible  actions  related  to 

weather  related 

the  weather 

Working 

memory 

Store  in 

store  information 

Working 

figure  out  if  activity  is 

Computational  Aid, 

Buffer 

on  current 

weather 

conditions 

memory 

related  to  weather 

Time  Constraints 

store  information 

Processing 

on  possible  actions 
related  to  the 

weather 

strategy 

Compute 

figure  out  if 

Processing 

determine  meaning 

Computational  Aid, 

activity  is  related 

strategy 

behind  current  weather 

Time  Constraints, 

to  the  current 

weather 

conditions 

conditions 

Expertise 

Working 

determine  relationship 

memory 

behind  activity  and  the 

weather 
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Plan 

expectations  of 
weather 

conditions 

Working 

memory 

determine  meaning 
behind  current  weather 

conditions 

Expectations, 

Expertise 

expectations  of 
how  the  weather 
affects  people's 
activities 

Processing 

strategy 

determine  meaning 
behind  activity 

determine  relationship 
behind  activity  and  the 
weather 

Interpret 

determine 
meaning  behind 
current  weather 

conditions 

Long-term 

memory 

define  weather  condition 

Expertise,  Knowledge, 
Number  of  Cues 

determine 
meaning  behind 
activity 

Sustained 

attention 

define  activity  as  weather 
related 

determine 
relationship 
behind  activity  and 
the  weather 


define  activity  as  not 
weather  related 


Categorize 

define  weather 

Long-term 

appropriate  and  optimal 

Expertise,  Knowledge, 

condition 

memory 

reaction  to  current 

weather  conditions 

Number  of  Cues 

define  activity  as 
weather  related 


Perceptual  appropriate  and  optimal 

sensitivity  reaction  activity  seen 


define  activity  as 
not  weather 

related 

appropriate  and  optimal 
reaction  to  relationship 
between  activity  seen  and 
weather  conditions 

Adapt/Learn 

appropriate  and 

Long-term 

efficient  knowledge  of 

Expertise,  Knowledge, 

optimal  reaction 

memory 

current  weather 

Number  of  Cues, 

to  current  weather 

conditions  to  complete 

Time  Constraints 

conditions 

mission 

appropriate  and 
optimal  reaction 
activity  seen 


efficient  visual  inspection 
of  activity  to  complete 
mission 


appropriate  and 
optimal  reaction 
to  relationship 
between  activity 
seen  and  weather 

conditions 

efficient  correlation 

between  weather  and 
activity  seen  to  complete 
mission 

Goal  Image 

efficient  visual 
inspection  of 
traffic  patterns  to 

Long-term 

memory 

further  inspection  needed 
to  determine  significance 
of  activity  based  on 

Quality  of  Feed, 
Salience,  Visibility, 
Rate  of  Change, 
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complete  mission 

weather  within  visual 

Activity  Levels, 

data  feed 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

efficient  visual 

Processing 

inspection  of 
traffic  timing  to 
complete  mission 

strategy 

efficient 

correlation 

between  weather 
and  activity  seen 
to  complete 
mission 

Patterns  of  Life/  Napping  on  Roof 

Cognitive  Input 

Agent  Task 

Human 

Information 

Processing 

Resources 

Output 

Task  and 

Environmental 

Demands 

Search 

weather  related 

Sustained 

recognize  and  label 

Salience,  Visibility, 

activity 

attention 

actions  weather  related 

Activity  Levels, 

Expertise,  Number  of 

Cues 

Perceptual  recognize  and  label 

sensitivity  timing 


Identify 

recognize  and 

Perceptual 

keep  relevant  weather 

Expertise,  Number  of 

label  weather 

discrimination 

related  actions  saved 

Cues,  Rates  of  Change 

related  activity 

in  Feed,  Situation 
Awareness 

recognize  and 
label  timing 

Long-term 

memory 

keep  timing  of  activities 
saved 

Working 

memory 

Store  in  Buffer 

keep  relevant 
weather  related 

actions  saved 

Working 

memory 

deviation  between 

normal  and  abnormal 

action  based  on  weather 

Computational  Aid, 

Time  Constraints 

keep  timing  of 
activities  saved 

Processing 

strategy 

deviation  between 

normal  and  abnormal 
timing  of  action  based  on 
weather  conditions 

Count 

track  amount  of 
people  performing 
activity 

Sustained 

attention 

deviation  between  actual 
number  of  people 
accounted  for  from 

Number  of  Competing 
Feeds,  Amount  of 
Activity 
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beginning  to  end 

Working 

memory 

Decide/Select 

normal  or 

Long-term 

match  activity  to  weather 

Number  of  Competing 

abnormal 

memory 

conditions 

Feeds,  Amount  of 

behavior  based  on 

Activity,  Expertise, 

weather 

Visibility,  Quality  of 

conditions 

Feed,  Rate  of  Change, 
Expectations 

normal  or 

Processing 

match  activity  to  time  of 

abnormal  timing 
of  behavior  based 

on  weather 

strategy 

day 

amount  of  people 
accounted  for  in 
performing 
activity 

Plan 

match  activity  to 

Working 

actual  behavior 

Expectations, 

weather 

conditions 

memory 

performed 

Expertise 

match  activity  to 

Processing 

actual  number  of  people 

time  of  day 

strategy 

accounted  for 

Test  actual  behavior  Perceptual  potential  need  for  Knowledge,  Expertise 

performed  sensitivity  further  investigation 


actual  number  of 
people  accounted 
for 

Working 

memory 

Long-term 

memory 


Interpret 

potential  need  for 

Long-term 

reason  for  behavior 

Expertise,  Knowledge, 

further 

investigation 

memory 

Number  of  Cues 

Sustained 

estimate  of  unaccounted 

attention 

for  people 

reason  for  unaccounted 
for  people 

Categorize 

reason  for 

Long-term 

efficient  visual  inspection 

Expertise,  Knowledge, 

behavior 

memory 

of  weather  related 

Number  of  Cues 

activity  to  complete 
mission 


estimate  of 

unaccounted  for 
people 

Perceptual 

sensitivity 

reason  for 

unaccounted  for 
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people 


Goal  Image 

efficient  visual 
inspection  of 
weather  related 
activity  to 
complete  mission 

Long-term 

memory 

further  inspection 
needed  to  determine 
significance  of  activity 

Quality  of  Feed, 
Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing  further  inspection 

strategy  needed  to  determine 

significance  of  time 

further  inspection 
needed  to  determine 
significance  of 
unaccountable  people  or 
person 

Patterns  of  Life/  Significance  of  Local  Norm  Examination 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Identify 

recognize  and 

Perceptual 

keep  relevant  actions 

Expertise,  Number  of 

label  local  norm 

discrimination 

saved 

Cues,  Rates  of  Change 

under  inspection 

in  Feed,  Situation 

as  suspicious 
behavior 

Awareness 

recognize  and 

Long-term 

store  information  on 

label  abnormal 

memory 

current  local  norms  for 

timing  of  local 
events 

selected  AOI 

recognize  and 

Working 

label  abnormal 
patterns  of  traffic 

memory 

Store  in  Buffer 

keep  relevant 

Working 

figure  out  if  activity  is  a 

Computational  Aid, 

actions  saved 

memory 

local  norm 

Time  Constraints 

store  information 

Processing 

figure  out  if  activity  is 

on  current  local 

norms  for 

selected  AOI 

strategy 

significant 

Compute 

figure  out  if 

Processing 

track  people  performing 

Computational  Aid, 

activity  is  a  local 

strategy 

activity 

Time  Constraints, 

norm 

Expertise 
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figure  out  if 
activity  is 
significant 

Working 

memory 

Count  track  people  Sustained  people  performing  Number  of  Competing 

under  inspection  attention  normal  or  abnormal  Feeds,  Amount  of 

activity  Activity 

Working 

memory 

Decide/Select 

normal  or 

abnormal  actions 

Long-term 

memory 

continue  to  match  to 

normal  observed 

behavior 

Number  of  Competing 
Feeds,  Amount  of 
Activity,  Expertise, 
Visibility,  Quality  of 
Feed,  Rate  of  Change, 
Expectations 

Processing 

continue  to  match  to 

strategy 

abnormal  observed 

behavior 

Plan 

match  to  normal 

Working 

test  current  behavior 

Expectations, 

observed  activities 

memory 

being  observed  to  normal 

Expertise 

match  to 

Processing 

test  current  behavior 

abnormal 

strategy 

being  observed  to 

observed  activities 

abnormal 

Test  test  activity  being  Perceptual  potential  need  for  Knowledge,  Expertise 


performed  to  sensitivity  further  investigation 

knowledge  of  a 
normal  activity 


test  activity  being 
performed  to 
knowledge  of  an 
abnormal  activity 

Working 

memory 

Long-term 

memory 

Interpret 

potential  need  for 
further 
investigation 
based  on 
interpretation 

Long-term 

memory 

reason  for  action 

Expertise,  Knowledge, 
Number  of  Cues 

Sustained 

attention 

Categorize 

reason  for  action 

Long-term 

memory 

efficient  visual  inspection 
of  actions  to  complete 
mission 

Expertise,  Knowledge, 
Number  of  Cues 

Perceptual 

sensitivity 

Adapt/Learn 

appropriate  and 
optimal  reaction 
to  actions 

Long-term 

memory 

efficient  visual  inspection 
of  activity  to  complete 
mission 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 
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performed 

Goal  Image 

efficient  visual 

Long-term 

further  inspection  with 

Quality  of  Feed, 

inspection  of 

memory 

FMV 

Salience,  Visibility, 

activity  to 

Rate  of  Change, 

complete  mission 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

further  inspection  with 

strategy 

WAMI 

stop  inspection  of 
current  activity  and 
continue  scanning  for 
other  patterns  of  life 
activities 

Patterns  of  Life/  Ignore  Local  Norms 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Identify 

recognize  and 

Perceptual 

dispose  information  on 

Expertise,  Number  of 

label  normal 

discrimination 

inspected  locally  normal 

Cues,  Rates  of  Change 

behavior  of 

activity 

in  Feed,  Situation 

activity 

Awareness 

recognize  and 

Long-term 

label  normal 
timing  of  local 
events 

memory 

recognize  and 

Working 

label  normal 
traffic  patterns 

memory 

recognize  and 
label  activity  as 
non-significant 
based  on  pattern 
of  life 

Purge 

dispose 

Selective 

ignore  past  activity 

Expertise 

information  on 
inspected  locally 
normal  activity 

attention 

observed 

Decide/Select 

ignore  past 

Long-term 

begin  new  scan 

Number  of  Competing 

activity  observed 

memory 

Feeds,  Amount  of 
Activity,  Expertise, 
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Visibility,  Quality  of 
Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

Control 

begin  new  scan 

Response 

need  for  further 

Expertise,  Knowledge, 

Precision 

investigation  of  other 

Number  of  Cues,  Time 

activities  within  watch 

window 

Constraints 

Interpret 

need  for  further 

Long-term 

thorough  inspection  of  all 

Expertise,  Knowledge, 

investigation  of 

memory 

locally  normal  activities 

Number  of  Cues 

other  activities 

within  watch 

window 

to  complete  mission 

Sustained 

attention 

Goal  Image 

thorough 

Long-term 

make  judgment  on  local 

Quality  of  Feed, 

inspection  of  all 

memory 

norms  to  complete 

Salience,  Visibility, 

locally  normal 

mission 

Rate  of  Change, 

activities  to 

Activity  Levels, 

complete  mission 

Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 

Customer  Gives  AOI(s)/  Create  Watch  Window(s) 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

recognize  and  label 

Salience,  Rate  of 

customer's 

attention 

message  as  an  AOI 

Change  in  Feed, 

message 

Visibility,  Activity 

Levels,  Expertise 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

written  or  verbal 

Expertise,  Number  of 

label  message  as 

discrimination 

message  of  multiple 

Cues,  Rates  of  Change 

multiple  AOIs 

AOI's  needed  for  mission 

in  Feed,  Situation 
Awareness 

Long-term 

memory 

Working 
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memory 

Message 

written  or  verbal 
message  of 
multiple  AOI's 
needed  for 

mission 

Response 

precision 

keep  location  of  AOI  for 
future  use 

Expertise,  Knowledge, 
Quality  of  Oral 
Communication, 

Quality  of  Chat  Room 

Store 

keep  location  of 

AOI  for  future  use 

Working 

memory 

use  locations  of  AOIs  to 
figure  out  if  multiple 
watch  windows  are 

needed  for  AOIs 

Computational  Aid, 

Time  Constraints 

Long-term 

memory 


Compute 

use  locations  of 

Processing 

use  a  separate  watch 

Computational  Aid, 

AOIs  to  figure  out 
if  multiple  watch 
windows  are 

needed  for  AOIs 

strategy 

window  for  every  AOI 

Time  Constraints, 
Expertise 

Working  use  watch  windows  and 

memory  main  screen  for  AOIs 


Count 

use  a  separate 

Sustained 

create  watch  windows 

Number  of  Competing 

watch  window  for 

attention 

Feeds,  Amount  of 

every  AOI 

Activity 

use  watch  Working 

windows  and  memory 

main  screen  for 
AOIs 


Decide/Select 

create  watch 

Long-term 

make  sure  correct  area 

Number  of  Competing 

windows 

memory 

Feeds,  Amount  of 
Activity,  Expertise, 
Visibility,  Quality  of 
Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

make  sure  can  tell  the 

difference  between  each 

watch  window 

Test 

make  sure  correct 

area 

Perceptual 

sensitivity 

define  or  name  watch 

window 

Knowledge,  Expertise 

make  sure  can  tell  Working 
the  difference  memory 
between  each 
watch  window 


Long-term 

memory 

Categorize 

define  or  name 

watch  window 

Long-term 

memory 

appropriate  and  optimal 
reaction  to  multiple  AOIs 
given  by  customer 

Expertise,  Knowledge, 
Number  of  Cues 

Perceptual 
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sensitivity 

Adapt/Learn  appropriate  and 

Long-term 

ability  to  efficiently 

Expertise,  Knowledge, 

optimal  reaction 

memory 

visualize  multiple  AOIs  to 

Number  of  Cues,  Time 

to  multiple  AOIs 
given  by  customer 

complete  mission 

Constraints 

Goal  Image 

ability  to 
efficiently 
visualize  multiple 
AOIs  to  complete 
mission 

Long-term 

memory 

multiple  watch  windows 
created  to  efficiently 
view  all  AOIs  given  by 
customer 

Quality  of  Feed, 
Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 

Customer  Gives  AOI(s)/  Define  Starting  Point(s) 

Cognitive 

Input 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

recognize  AOI 

Salience,  Rate  of 

AOI  given 

attention 

Change  in  Feed, 
Visibility,  Activity 

Levels,  Expertise 

pay  attention  to 

Perceptual 

recognize  POL  activity 

new  POL  activity 

sensitivity 

Identify 

recognize  AOI 

Perceptual 

keep  location  of  AOI  for 

Expertise,  Number  of 

discrimination 

future  use 

Cues,  Rates  of  Change 
in  Feed,  Situation 
Awareness 

recognize  POL 

Long-term 

keep  POL  activity  for 

activity 

memory 

future  use 

Working 

memory 

Store 

keep  location  of 

Working 

compute  starting  point 

Computational  Aid, 

AOI  for  future  use 

memory 

for  scanning  watch 
windows  based  on 

location  of  AOI 

Time  Constraints 

keep  POL  activity 

Long-term 

compute  starting  point 

for  future  use 

memory 

for  scanning  watch 
windows  based  on  POL 
activity 

Compute 

compute  starting 

Processing 

choose  starting  point 

Computational  Aid, 
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point  for  scanning  strategy  Time  Constraints, 

watch  windows  Expertise 

Working 

memory 

if  starting  scan  for  new 

POL  activity  get  rid  of  old 
POL  activity  details 

Purge  if  starting  scan  for  Selective  choose  starting  point  Expertise 

new  POL  activity  attention 

get  rid  of  old  POL 
activity  details 

Decide/Select 

choose  starting 
point 

Long-term 

memory 

to  efficiently  inspect  POL 
activity  to  complete 
mission 

Number  of  Competing 
Feeds,  Amount  of 
Activity,  Expertise, 
Visibility,  Quality  of 
Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

Goal  Image 

ability  to 

efficiently  inspect 
POL  activity  to 
complete  mission 

Long-term 

memory 

define  starting  points  to 
inspect  POL  activity 

Quality  of  Feed, 

Salience,  Visibility, 

Rate  of  Change, 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 

Expectations, 

Knowledge 

Processing 

strategy 

Define  Starting  Point(s)/  Slow  Scan 

Cognitive 

Example 

Human 

Output 

Task  and 

Agent  Task 

Information 

Environmental 

Processing 

Resources 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity 

Salience,  Rate  of 

potential  POL 

attention 

in  watch  window 

Change  in  Feed, 

activities 

Visibility,  Activity 

Levels,  Expertise 

pay  attention  to 

Perceptual 

target 

sensitivity 

Filter 

filter  out  rest  of 

Selective 

determine  if  activity 

Quality  of  Feed, 

activity  in  watch 

attention 

requires  attention 

Visibility,  Salience, 

window 

Visibility,  Rate  of 

Change,  Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
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Number  of  Cues, 
Expertise,  Expectations 

Detect 

determine  if 

Perceptual 

slowly  search  for  only 

Expertise,  Expectations 

activity  requires 
attention 

sensitivity 

POL  activities 

Distributed 

attention 

Search 

slowly  search  for 

Sustained 

recognize  and  label 

Salience,  Visibility, 

only  POL  activities 

attention 

activities 

Activity  Levels, 

Expertise,  Number  of 
Cues 

Perceptual 

sensitivity 

Identify 

recognize  and 

Perceptual 

store  relevant 

Expertise,  Number  of 

label  activities 

discrimination 

information  on  activity 

Cues,  Rates  of  Change 

in  Feed,  Situation 
Awareness 


Long-term 

memory 

Working 

memory 

Store  in  Buffer 

store  relevant 

information  on 
activity 

Working 

memory 

figure  out  if  activity  is 

POL 

Computational  Aid, 

Time  Constraints 

Processing 

strategy 

Compute 

figure  out  if 
activity  is  POL 

Processing 

strategy 

expectations  of  a  POL 
activity 

Computational  Aid, 

Time  Constraints, 
Expertise 

Working 

memory 

Count 

keep  track  of 
number  of 

individual's 

performing 

activity 

Sustained 

attention 

expectations  of  a  POL 
activity 

Number  of  Competing 
Feeds,  Amount  of 

Activity 

Working 

memory 

Plan 

expectations  of  a 
POL  activity 

Working 

memory 

determine  meaning  of 
activity  observed 

Expectations,  Expertise 

Processing 

strategy 

Interpret 

determine 
meaning  of 
activity  observed 

Long-term 

memory 

define  and  name  activity 
as  POL 

Expertise,  Knowledge, 
Number  of  Cues 

Sustained 

attention 
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Categorize  define  and  name  Long-term  inspect  POL  activity  Expertise,  Knowledge, 

activity  as  POL  memory  Number  of  Cues, 


Quality  of  Feed, 
Expectations 


Perceptual 

sensitivity 

communicate  with 

customer 

Adapt/Learn 

responses  to 
certain  activity 

Long-term 

memory 

confirming  POL  activity 

Expertise,  Knowledge, 
Number  of  Cues,  Time 
Constraints 

reason  to  communicate 

Goal  Image  inspect  POL  Long-term  further  scanning  for  Quality  of  Feed, 

activity  memory  inspection  of  POL  activity  Salience,  Visibility,  Rate 


of  Change,  Activity 
Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 
Cues,  Expertise, 
Expectations, 
Knowledge 


communicate  with 

customer 

Processing 

strategy 

Scanning/Switch  to  FMV 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  &  Environmental 

Demands 

Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity 

Salience,  Rate  of 

POL  activity  found 

attention 

Change  in  Feed, 

significant 

Visibility,  Activity 

Levels,  Expertise 

Perceptual 

sensitivity 


Filter 

filter  out  rest  of 

Selective 

keep  relevant 

Quality  of  Feed, 

activity 

attention 

information  on  POL 

Visibility,  Salience, 

activity  for  future  use 

Visibility,  Rate  of 

Change,  Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise,  Expectations 

Store  keep  relevant  Working  find  POL  activity  in  FMV  Computational  Aid, 


information  on  memory  Time  Constraints 

POL  activity  for 
future  use 


218 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


Long-term 

memory 

Reset 

need  more 

Selective 

switch  to  FMV 

Expertise 

detailed  view  of 
activity 

attention 

Response 

precision 

Decide/Select 

switch  to  FMV 

Long-term 

expect  FMV  to  show  POL 

Number  of  Competing 

memory 

activity 

Feeds,  Amount  of 
Activity,  Expertise, 
Visibility,  Quality  of 

Feed,  Rate  of  Change, 
Expectations 

Processing 

strategy 

Plan 

expect  FMV  to 

Working 

response  to  need  for 

Expectations,  Expertise 

show  POL  activity 

memory 

more  detail  on  POL 
activity 

Processing 

strategy 

Adapt/Learn 

response  to  need 

Long-term 

efficient  visual  inspection 

Expertise,  Knowledge, 

for  more  detail  on 

memory 

using  all  resources  to 

Number  of  Cues,  Time 

POL  activity 

complete  mission 

Constraints 

Goal  Image 


efficient  visual 
inspection  using 
all  resources  to 
complete  mission 


Long-term  switch  to  FMV  for  more 

memory  detailed  view  of  POL 

activity 


Quality  of  Feed, 
Salience,  Visibility,  Rate 
of  Change,  Activity 
Levels,  Competing 
Watch  Window  or 
Feeds,  Number  of 
Cues,  Expertise, 
Expectations, 
Knowledge 


Processing 

strategy 

Scanning/Black/White  Inversion  in  WAMI 

Cognitive 
Agent  Task 

Input 

Human 

Information 

Processing 

Resources 

Output 

Task  & 

Environmental 

Demands 

Input  Select 

pay  attention  to 

POL  activity  found 
significant 

Selective 

attention 

filter  out  rest  of  activity 

Salience,  Rate  of 
Change  in  Feed, 
Visibility,  Activity 
Levels,  Expertise 

Perceptual 
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sensitivity 

Filter 
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Window  or  Feeds, 
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221 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


strategy 

Plan 

expect  altered 

Working 

response  to  need  for 

Expectations, 

brightness  of 

memory 

more  detail  on  POL 

Expertise 

WAMI  to  show 

more  detail  of  POL 
activity 

activity 

Processing 
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Adapt/Learn  response  to  need  Long-term  efficient  visual  inspection  Expertise, 
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Goal  Image 
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Scanning/Change  View  in  WAMI 
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Input 

Human 

Output 

Task  & 

Agent  Task 
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Processing 
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Input  Select 

pay  attention  to 

Selective 

filter  out  rest  of  activity 

Salience,  Rate  of 
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Change  in  Feed, 
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Perceptual 

sensitivity 

Filter 

filter  out  rest  of 

Selective 
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Quality  of  Feed, 

activity 

attention 

information  on  POL 
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find  POL  activity  in  new 

Computational  Aid, 

information  on 

POL  activity  for 
future  use 

memory 

view  of  WAMI 

Time  Constraints 
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Amount  of  Activity, 
Expertise,  Visibility, 
Quality  of  Feed,  Rate 
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Processing 

strategy 
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Working 
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response  to  need 

Long-term 
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for  more  detail  on  memory  using  all  resources  to  Knowledge,  Number 

POL  activity  complete  mission  of  Cues,  Time 


Constraints 
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efficient  visual 
inspection  using 
all  resources  to 
complete  mission 

Long-term 

memory 
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Human 
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discrimination 

saved 
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Situation  Awareness 
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Working 
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Working 
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Processing 
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Processing 
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Working 
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Decide/Select 
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Long-term 

continue  to  match  to 
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abnormal  actions 
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normal  observed 
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behavior 
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Quality  of  Feed,  Rate 
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Working 
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Processing 
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abnormal 
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potential  need  for 
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further  investigation 
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Working 
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abnormal  activity 

memory 
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memory 

Interpret 

potential  need  for 
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reason  for  action 
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further 
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investigation 
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interpretation 
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attention 
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Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 


Processing 

determined  non- 

strategy 

significant 

document  for  final 
product  report 


Scanning/Re-Orient  WAMI 
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Processing 
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Input  Select 
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Working 
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Compute 
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Tracking/  Switch  to  FMV 
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Working 
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Processing 

strategy 
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230 

Distribution  A:  Approved  for  public  release;  distribution  is  unlimited. 
88ABW-20 13-5 113;  Cleared  04  December  2013 


Constraints 

responding  to 
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efficient  tracking  of 
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repositioning  of 
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Change  in  Feed, 
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recognize  and 

Long-term 

track  target 

label  movement 
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of  target 

Working 

memory 


Count 
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track  target 

Number  of 
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attention 
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Decide/Select 
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Processing 

strategy 


Plan 

plan  for  tracking 
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Expertise 
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Long-term 
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Levels,  Expertise 

Perceptual 
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filter  out  rest  of 
activity  in  watch 
window 
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Cues,  Expertise, 
Expectations 
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Decide/Select 
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target  to  complete 

Competing  Feeds, 

mission 

Amount  of  Activity, 
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Expertise,  Visibility, 
Quality  of  Feed, 

Rate  of  Change, 
Expectations 

Processing 

strategy 

Goal  Image 

ability  to 

Long-term 

define  starting  points  to 

Quality  of  Feed, 

efficiently  track  a 

memory 

track  a  target  for  a 

Salience,  Visibility, 

target  to 

successful  mission 

Rate  of  Change, 

complete  mission 

Activity  Levels, 
Competing  Watch 
Window  or  Feeds, 
Number  of  Cues, 
Expertise, 
Expectations, 
Knowledge 

Processing 

strategy 
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LIST  OF  ACRONYMS 


AOI 

Area  Of  Interest 

CIED 

Counter-IED 

CTA 

Cognitive  Task  Analysis 

CW 

Cognitive  Walkthrough 

EEI 

Essential  Element  of  Information 

FMV 

Full  Motion  Video 

FOV 

Field  Of  View 

GOMS 

Goals,  Operators,  Methods,  and  Selection  Rules 

GUI 

Graphical  User  Interface 

HCI 

Human-Computer  Interface 

IA 

Imagery  Analyst 

IED 

Improvised  Explosive  Device 

IMS 

Imagery  Mission  Supervisor 

IR 

Infrared 

ISR 

Intelligence,  Surveillance,  &  Reconnaissance 

KML 

Keyhole  Markup  Language 

MOC 

Mission  Operations  Chief 

OFM 

OFM- 

Operator  Function  Model 

COG 

Operator  Function  Model  -  Cognitive  Operations 

POL 

Patterns  Of  Life 

RFI 

Request  For  Infonnation 

UAV 

Unmanned  Aerial  Vehicle 

WAMI 

Wide-Area  Motion  Imagery 

WAPS 

Wide-Area  Persistent  Surveillance 
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